org.apache.hadoop.mapreduce.split

Class TezGroupedSplitsInputFormat<K,V>

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat<K,V>

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

@InterfaceAudience.Public
@InterfaceStability.Evolving
public class TezGroupedSplitsInputFormat<K,V>
extends org.apache.hadoop.mapreduce.InputFormat<K,V>
implements org.apache.hadoop.conf.Configurable

An InputFormat that provides a generic grouping around the splits of a real InputFormat

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	TezGroupedSplitsInputFormat.TezGroupedSplitsRecordReader

Constructor Summary

Constructors

Constructor and Description
TezGroupedSplitsInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<K,V>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
org.apache.hadoop.conf.Configuration	getConf()
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context)
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	setDesiredNumberOfSplits(int num)
void	setInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> wrappedInputFormat)
void	setSplitLocationProvider(SplitLocationProvider locationProvider)
void	setSplitSizeEstimator(SplitSizeEstimator estimator)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TezGroupedSplitsInputFormat

public TezGroupedSplitsInputFormat()

Method Detail

setInputFormat

public void setInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> wrappedInputFormat)

setDesiredNumberOfSplits

public void setDesiredNumberOfSplits(int num)

setSplitSizeEstimator

public void setSplitSizeEstimator(SplitSizeEstimator estimator)

setSplitLocationProvider

public void setSplitLocationProvider(SplitLocationProvider locationProvider)

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context)
                                                       throws IOException,
                                                              InterruptedException

Specified by:

getSplits in class org.apache.hadoop.mapreduce.InputFormat<K,V>

Throws:

IOException

InterruptedException

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<K,V> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                               org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                 throws IOException,
                                                                        InterruptedException

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<K,V>

Throws:

IOException

InterruptedException

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable