A C F G H I M O P R S T U W

A

abort() - Method in class org.apache.tez.mapreduce.output.MROutput

MROutput expects that a Processor call abort in case of any error ( including an error during commit ) prior to the Processor's completion

abortOutput(VertexStatus.State) - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter

addSplit(InputSplit) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit

addSplit(InputSplit) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit

C

close() - Method in class org.apache.tez.mapreduce.input.MRInput

close() - Method in class org.apache.tez.mapreduce.input.MultiMRInput

close() - Method in class org.apache.tez.mapreduce.output.MROutput

combine(TezRawKeyValueIterator, IFile.Writer) - Method in class org.apache.tez.mapreduce.combine.MRCombiner

commit() - Method in class org.apache.tez.mapreduce.output.MROutput

MROutput expects that a Processor call commit prior to the Processor's completion

commitOutput() - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter

committer - Variable in class org.apache.tez.mapreduce.output.MROutput

configureMRApiUsage(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers

Update the provided configuration to use the new API (mapreduce) or the old API (mapred) based on the configured InputFormat, OutputFormat, Partitioner etc.

configureMRInputWithLegacySplitGeneration(Configuration, Path, boolean) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers

Setup split generation on the client, with splits being distributed via the traditional MapReduce mechanism of distributing splits via the Distributed Cache.

createConfigBuilder(Configuration) - Static method in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

Builder that can be used to configure grouping in Tez

createConfigBuilder(Configuration, Class<?>) - Static method in class org.apache.tez.mapreduce.input.MRInput

Create an MRInput.MRInputConfigBuilder

createConfigBuilder(Configuration, Class<?>, String) - Static method in class org.apache.tez.mapreduce.input.MRInput

Create an MRInput.MRInputConfigBuilder for FileInputFormat or FileInputFormat format based InputFormats.

createConfigBuilder(Configuration, Class<?>) - Static method in class org.apache.tez.mapreduce.input.MultiMRInput

Create an MultiMRInput.MultiMRInputConfigBuilder to configure a MultiMRInput

createConfigBuilder(Configuration, Class<?>) - Static method in class org.apache.tez.mapreduce.output.MROutput

Create an MROutput.MROutputConfigBuilder

createConfigBuilder(Configuration, Class<?>, String) - Static method in class org.apache.tez.mapreduce.output.MROutput

Create an MROutput.MROutputConfigBuilder for a FileOutputFormat or FileOutputFormat based OutputFormats.

createMRInputPayload(Configuration, MRRuntimeProtos.MRSplitsProto) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers

createMRInputPayloadWithGrouping(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers

Called to specify that grouping of input splits be performed by Tez The conf should have the input format class configuration set to the TezGroupedSplitsInputFormat.

createNewFormatSplitFromUserPayload(MRRuntimeProtos.MRSplitProto, SerializationFactory) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers

Create an instance of InputSplit from the MRInput representation of a split.

createOldFormatSplitFromUserPayload(MRRuntimeProtos.MRSplitProto, SerializationFactory) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers

Create an instance of InputSplit from the MRInput representation of a split.

createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat

createSplitProto(T, SerializationFactory) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers

createSplitProto(InputSplit) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers

F

flush() - Method in class org.apache.tez.mapreduce.output.MROutput

Call this in the processor before finishing to ensure outputs that outputs have been flushed.

G

generateInputSplitsToMem(Configuration, boolean, int) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers

Generates Input splits and stores them in a MRRuntimeProtos.MRSplitsProto instance.

getConf() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit

getConf() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat

getConf() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit

getConf() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat

getConfigUpdates() - Method in class org.apache.tez.mapreduce.input.MRInput

MRInput sets some additional parameters like split location when using the new API.

getGroupedSplits() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit

getGroupedSplits(Configuration, InputSplit[], int, String) - Method in class org.apache.hadoop.mapred.split.TezMapredSplitsGrouper

getGroupedSplits(Configuration, InputSplit[], int, String, SplitSizeEstimator) - Method in class org.apache.hadoop.mapred.split.TezMapredSplitsGrouper

getGroupedSplits() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit

getGroupedSplits(Configuration, List<InputSplit>, int, String) - Method in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

getGroupedSplits(Configuration, List<InputSplit>, int, String, SplitSizeEstimator) - Method in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

getJavaOptsForMRAM(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers

Generate JVM options based on MapReduce AM java options.

getJavaOptsForMRMapper(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers

Generate JVM options based on MapReduce mapper java options.

getJavaOptsForMRReducer(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers

Generate JVM options based on MapReduce reducer java options.

getKeyValueReaders() - Method in class org.apache.tez.mapreduce.input.MultiMRInput

getLength() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit

getLength() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit

getLocations() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit

getLocations() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit

getPartition(Object, Object, int) - Method in class org.apache.tez.mapreduce.partition.MRPartitioner

getProgress() - Method in class org.apache.tez.mapreduce.input.MRInput

getRack() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit

getRack() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit

getReader() - Method in class org.apache.tez.mapreduce.input.MRInput

Returns a KeyValueReader that can be used to read Map Reduce compatible key value data.

getReader() - Method in class org.apache.tez.mapreduce.input.MultiMRInput

getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat

getResourceForMRMapper(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers

Extract the container resource requirements from the provided configuration, which would otherwise have been used when running a Hadoop MapReduce mapper.

getResourceForMRReducer(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers

Extract the container resource requirements from the provided configuration, which would otherwise have been used when running a Hadoop MapReduce reducer.

getSplits(JobConf, int) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat

getSplits(JobContext) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat

getWriter() - Method in class org.apache.tez.mapreduce.output.MROutput

Get a key value write to write Map Reduce compatible output

H

handleEvents(List<Event>) - Method in class org.apache.tez.mapreduce.input.MRInput

handleEvents(List<Event>) - Method in class org.apache.tez.mapreduce.input.MultiMRInput

handleEvents(List<Event>) - Method in class org.apache.tez.mapreduce.output.MROutput

handleInputInitializerEvent(List<InputInitializerEvent>) - Method in class org.apache.tez.mapreduce.common.MRInputAMSplitGenerator

handleInputInitializerEvent(List<InputInitializerEvent>) - Method in class org.apache.tez.mapreduce.common.MRInputSplitDistributor

I

initCommitter(JobConf, boolean) - Method in class org.apache.tez.mapreduce.output.MROutput

initialize() - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter

initialize() - Method in class org.apache.tez.mapreduce.common.MRInputAMSplitGenerator

initialize() - Method in class org.apache.tez.mapreduce.common.MRInputSplitDistributor

initialize() - Method in class org.apache.tez.mapreduce.input.MRInput

initialize() - Method in class org.apache.tez.mapreduce.input.MultiMRInput

initialize() - Method in class org.apache.tez.mapreduce.output.MROutput

isCommitRequired() - Method in class org.apache.tez.mapreduce.output.MROutput

isTaskRecoverySupported() - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter

M

MRCombiner - Class in org.apache.tez.mapreduce.combine

Implements a Map Reduce compatible combiner

MRCombiner(TaskContext) - Constructor for class org.apache.tez.mapreduce.combine.MRCombiner

MRHelpers - Class in org.apache.tez.mapreduce.hadoop

This class contains helper methods for frameworks which migrate from MapReduce to Tez, and need to continue to work with existing MapReduce configurations.

MRHelpers() - Constructor for class org.apache.tez.mapreduce.hadoop.MRHelpers

MRInput - Class in org.apache.tez.mapreduce.input

MRInput is an Input which provides key/values pairs for the consumer.

MRInput(InputContext, int) - Constructor for class org.apache.tez.mapreduce.input.MRInput

MRInputAMSplitGenerator - Class in org.apache.tez.mapreduce.common

Implements an InputInitializer that generates Map Reduce splits in the App Master.

MRInputAMSplitGenerator(InputInitializerContext) - Constructor for class org.apache.tez.mapreduce.common.MRInputAMSplitGenerator

MRInputHelpers - Class in org.apache.tez.mapreduce.hadoop

MRInputHelpers() - Constructor for class org.apache.tez.mapreduce.hadoop.MRInputHelpers

MRInputSplitDistributor - Class in org.apache.tez.mapreduce.common

Implements an InputInitializer that distributes Map Reduce splits created by the client to tasks in the Vertex This can be used when certain reasons (e.g.

MRInputSplitDistributor(InputInitializerContext) - Constructor for class org.apache.tez.mapreduce.common.MRInputSplitDistributor

MROutput - Class in org.apache.tez.mapreduce.output

MROutput is an Output which allows key/values pairs to be written by a processor.

MROutput(OutputContext, int) - Constructor for class org.apache.tez.mapreduce.output.MROutput

MROutputCommitter - Class in org.apache.tez.mapreduce.committer

Implements the OutputCommitter and provide Map Reduce compatible output commit operations for Map Reduce compatible data sinks.

MROutputCommitter(OutputCommitterContext) - Constructor for class org.apache.tez.mapreduce.committer.MROutputCommitter

MRPartitioner - Class in org.apache.tez.mapreduce.partition

Provides an implementation of Partitioner that is compatible with Map Reduce partitioners.

MRPartitioner(Configuration) - Constructor for class org.apache.tez.mapreduce.partition.MRPartitioner

mrReader - Variable in class org.apache.tez.mapreduce.input.MRInput

MultiMRInput - Class in org.apache.tez.mapreduce.input

MultiMRInput(InputContext, int) - Constructor for class org.apache.tez.mapreduce.input.MultiMRInput

O

org.apache.hadoop.mapred.split - package org.apache.hadoop.mapred.split

org.apache.tez.client - package org.apache.tez.client

org.apache.tez.dag.api.client - package org.apache.tez.dag.api.client

org.apache.tez.mapreduce.combine - package org.apache.tez.mapreduce.combine

org.apache.tez.mapreduce.committer - package org.apache.tez.mapreduce.committer

org.apache.tez.mapreduce.common - package org.apache.tez.mapreduce.common

org.apache.tez.mapreduce.input - package org.apache.tez.mapreduce.input

org.apache.tez.mapreduce.input.base - package org.apache.tez.mapreduce.input.base

org.apache.tez.mapreduce.output - package org.apache.tez.mapreduce.output

org.apache.tez.mapreduce.partition - package org.apache.tez.mapreduce.partition

org.apache.tez.mapreduce.processor - package org.apache.tez.mapreduce.processor

org.apache.tez.mapreduce.processor.map - package org.apache.tez.mapreduce.processor.map

org.apache.tez.mapreduce.processor.reduce - package org.apache.tez.mapreduce.processor.reduce

org.apache.tez.mapreduce.protos - package org.apache.tez.mapreduce.protos

P

parseMRInputPayload(UserPayload) - Static method in class org.apache.tez.mapreduce.hadoop.MRInputHelpers

Parse the payload used by MRInputPayload

postOp() - Method in class org.apache.tez.mapreduce.processor.SimpleMRProcessor

R

readFields(DataInput) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit

readFields(DataInput) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit

recoverTask(int, int) - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter

S

setConf(Configuration) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit

setConf(Configuration) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat

setConf(Configuration) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit

setConf(Configuration) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat

setDesiredNumberOfSplits(int) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat

setDesiredNumberOfSplits(int) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat

setInputFormat(InputFormat<K, V>) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat

setInputFormat(InputFormat<K, V>) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat

setSplitSizeEstimator(SplitSizeEstimator) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat

setSplitSizeEstimator(SplitSizeEstimator) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat

setupOutput() - Method in class org.apache.tez.mapreduce.committer.MROutputCommitter

SimpleMRProcessor - Class in org.apache.tez.mapreduce.processor

A SimpleProcessor that provides Map Reduce specific post processing by calling commit (if needed) on all MROutputs connected to this Processor.

SimpleMRProcessor(ProcessorContext) - Constructor for class org.apache.tez.mapreduce.processor.SimpleMRProcessor

splitMetaInfo - Variable in class org.apache.tez.mapreduce.input.MRInput

start() - Method in class org.apache.tez.mapreduce.input.MRInput

start() - Method in class org.apache.tez.mapreduce.input.MultiMRInput

start() - Method in class org.apache.tez.mapreduce.output.MROutput

T

TEZ_GROUPING_RACK_SPLIT_SIZE_REDUCTION - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

This factor is used to decrease the per group desired (length and count) limits for groups created by combining splits within a rack.

TEZ_GROUPING_RACK_SPLIT_SIZE_REDUCTION_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

TEZ_GROUPING_REPEATABLE - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

Repeated invocations of grouping on the same splits with the same parameters will produce the same groups.

TEZ_GROUPING_REPEATABLE_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

TEZ_GROUPING_SPLIT_BY_COUNT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

Limit the number of splits in a group by the number of splits in the group

TEZ_GROUPING_SPLIT_BY_COUNT_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

TEZ_GROUPING_SPLIT_BY_LENGTH - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

Limit the number of splits in a group by the total length of the splits in the group

TEZ_GROUPING_SPLIT_BY_LENGTH_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

TEZ_GROUPING_SPLIT_COUNT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

Specify the number of splits desired to be created

TEZ_GROUPING_SPLIT_MAX_SIZE - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

Upper bound on the size (in bytes) of a grouped split, to avoid generating excessively large splits.

TEZ_GROUPING_SPLIT_MAX_SIZE_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

TEZ_GROUPING_SPLIT_MIN_SIZE - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

Lower bound on the size (in bytes) of a grouped split, to avoid generating too many small splits.

TEZ_GROUPING_SPLIT_MIN_SIZE_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

TEZ_GROUPING_SPLIT_WAVES - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

The multiplier for available queue capacity when determining number of tasks for a Vertex.

TEZ_GROUPING_SPLIT_WAVES_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

TezGroupedSplit - Class in org.apache.hadoop.mapred.split

Implements an InputSplit that provides a generic wrapper around a group of real InputSplits

TezGroupedSplit() - Constructor for class org.apache.hadoop.mapred.split.TezGroupedSplit

TezGroupedSplit(int, String, String[], String) - Constructor for class org.apache.hadoop.mapred.split.TezGroupedSplit

TezGroupedSplit(int, String, String[]) - Constructor for class org.apache.hadoop.mapred.split.TezGroupedSplit

TezGroupedSplit - Class in org.apache.hadoop.mapreduce.split

A Mapreduce InputSplit that provides a generic wrapper around a set of real InputSplits.

TezGroupedSplit() - Constructor for class org.apache.hadoop.mapreduce.split.TezGroupedSplit

TezGroupedSplit(int, String, String[], String) - Constructor for class org.apache.hadoop.mapreduce.split.TezGroupedSplit

TezGroupedSplit(int, String, String[]) - Constructor for class org.apache.hadoop.mapreduce.split.TezGroupedSplit

TezGroupedSplitsInputFormat<K,V> - Class in org.apache.hadoop.mapred.split

An InputFormat that provides a generic grouping around the splits of a real InputFormat

TezGroupedSplitsInputFormat() - Constructor for class org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat

TezGroupedSplitsInputFormat<K,V> - Class in org.apache.hadoop.mapreduce.split

An InputFormat that provides a generic grouping around the splits of a real InputFormat

TezGroupedSplitsInputFormat() - Constructor for class org.apache.hadoop.mapreduce.split.TezGroupedSplitsInputFormat

TezMapredSplitsGrouper - Class in org.apache.hadoop.mapred.split

A Helper that provides grouping logic to group InputSplits using various parameters.

TezMapredSplitsGrouper() - Constructor for class org.apache.hadoop.mapred.split.TezMapredSplitsGrouper

TezMapReduceSplitsGrouper - Class in org.apache.hadoop.mapreduce.split

Helper that provides a grouping of input splits based on multiple parameters.

TezMapReduceSplitsGrouper() - Constructor for class org.apache.hadoop.mapreduce.split.TezMapReduceSplitsGrouper

toString() - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit

toString() - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit

translateMRConfToTez(Configuration) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers

Translate MapReduce configuration keys to the equivalent Tez keys in the provided configuration.

translateMRConfToTez(Configuration, boolean) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers

Translate MapReduce configuration keys to the equivalent Tez keys in the provided configuration.

U

updateEnvBasedOnMRAMEnv(Configuration, Map<String, String>) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers

Setup environment variables based on the configured values for the MR AM

updateEnvBasedOnMRTaskEnv(Configuration, Map<String, String>, boolean) - Static method in class org.apache.tez.mapreduce.hadoop.MRHelpers

Setup classpath and other environment variables based on the configured values for MR Mappers or Reducers

W

write(DataOutput) - Method in class org.apache.hadoop.mapred.split.TezGroupedSplit

write(DataOutput) - Method in class org.apache.hadoop.mapreduce.split.TezGroupedSplit

A C F G H I M O P R S T U W