org.apache.tez.mapreduce.hadoop

Interface InputSplitInfo

All Known Implementing Classes:

InputSplitInfoDisk, InputSplitInfoMem

@InterfaceAudience.Private
@InterfaceStability.Unstable
public interface InputSplitInfo

Provides information about input splits.

The get*Path methods are only applicable when generating splits to disk. The getSplitsProto method is only applicable when generating splits to memory.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	InputSplitInfo.Type

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.security.Credentials	getCredentials() Get Credentials which may be required to access the splits.
org.apache.hadoop.mapreduce.InputSplit[]	getNewFormatSplits() Get new format splits.
int	getNumTasks() Get the number of splits that were generated.
org.apache.hadoop.mapred.InputSplit[]	getOldFormatSplits() Get old format splits.
org.apache.hadoop.fs.Path	getSplitsFile() Get the path to the splits file
org.apache.hadoop.fs.Path	getSplitsMetaInfoFile() Get the path to the splits meta info file
MRRuntimeProtos.MRSplitsProto	getSplitsProto() Get the splits proto
List<org.apache.tez.dag.api.TaskLocationHint>	getTaskLocationHints() Get the TaskLocationHints for each task
InputSplitInfo.Type	getType() Get the InputSplitInfo.Type of the InputSplitInfo
boolean	holdsNewFormatSplits() Check whether the current instance is using old / new format splits

Method Detail

getTaskLocationHints

List<org.apache.tez.dag.api.TaskLocationHint> getTaskLocationHints()

Get the TaskLocationHints for each task

getSplitsMetaInfoFile

org.apache.hadoop.fs.Path getSplitsMetaInfoFile()

Get the path to the splits meta info file

getSplitsFile

org.apache.hadoop.fs.Path getSplitsFile()

Get the path to the splits file

getSplitsProto

MRRuntimeProtos.MRSplitsProto getSplitsProto()

Get the splits proto

getNumTasks

int getNumTasks()

Get the number of splits that were generated. Same as number of tasks that should be run for the vertex processing these set of splits.

getType

InputSplitInfo.Type getType()

Get the InputSplitInfo.Type of the InputSplitInfo

getCredentials

org.apache.hadoop.security.Credentials getCredentials()

Get Credentials which may be required to access the splits.

Returns:

Credentials which may be required to access the splits.

holdsNewFormatSplits

boolean holdsNewFormatSplits()

Check whether the current instance is using old / new format splits

Returns:

true if using new format splits, false otherwise

getNewFormatSplits

org.apache.hadoop.mapreduce.InputSplit[] getNewFormatSplits()

Get new format splits. Should only be used if the mapreduce API is being used

Returns:

array of mapreduce format splits

getOldFormatSplits

org.apache.hadoop.mapred.InputSplit[] getOldFormatSplits()

Get old format splits. Should only be used if the mapred API is being used

Returns:

array of mapred format splits