A B C D F G H I K M N O P R S T U V W

A

accept(Class<?>) - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization

assignMemory(long, int, int, Iterable<InitialMemoryRequestContext>) - Method in class org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor

B

build() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

Create the actual configuration instance.

build() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

Build and return an instance of the configuration

build() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

Create the actual configuration instance.

build() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder

Build and return an instance of the configuration

build() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder

Create the actual configuration instance.

build() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder

Create the actual configuration instance.

build() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder

Build and return an instance of the configuration

build() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder

Create the actual configuration instance.

C

close() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

close() - Method in class org.apache.tez.runtime.library.input.UnorderedKVInput

close() - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

close() - Method in class org.apache.tez.runtime.library.output.UnorderedKVOutput

close() - Method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput

close() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor

compare(byte[], int, int, byte[], int, int) - Method in class org.apache.tez.runtime.library.common.comparator.TezBytesComparator

Compare the buffers in serialized form.

ConcatenatedMergedKeyValueInput - Class in org.apache.tez.runtime.library.input

Implements a MergedLogicalInput that merges the incoming inputs (e.g.

ConcatenatedMergedKeyValueInput(MergedInputContext, List<Input>) - Constructor for class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValueInput

ConcatenatedMergedKeyValuesInput - Class in org.apache.tez.runtime.library.input

Implements a MergedLogicalInput that merges the incoming inputs (e.g.

ConcatenatedMergedKeyValuesInput(MergedInputContext, List<Input>) - Constructor for class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValuesInput

conf - Variable in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

conf - Variable in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

configureInput() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

Configure the specific input

configureInput() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder

Configure the specific input

configureInput() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder

Configure the specific input

configureOutput() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

Configure the specific output

configureOutput() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder

Configure the specific output

configureOutput() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder

Configure the specific output

createConfigBuilder(Configuration) - Static method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

Create a VertexManagerPluginDescriptor builder that can be used to configure the plugin.

createDefaultBroadcastEdgeProperty() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig

This is a convenience method for the typical usage of this edge, and creates an instance of EdgeProperty which is likely to be used.

createDefaultCustomEdgeProperty(EdgeManagerPluginDescriptor) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig

This is a convenience method for creating an Edge descriptor based on the specified EdgeManagerDescriptor.

createDefaultCustomEdgeProperty(EdgeManagerPluginDescriptor) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig

This is a convenience method for creating an Edge descriptor based on the specified EdgeManagerDescriptor.

createDefaultCustomEdgeProperty(EdgeManagerPluginDescriptor) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig

This is a convenience method for creating an Edge descriptor based on the specified EdgeManagerDescriptor.

createDefaultEdgeProperty() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig

This is a convenience method for the typical usage of this edge, and creates an instance of EdgeProperty which is likely to be used.

createDefaultEdgeProperty() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig

This is a convenience method for the typical usage of this edge, and creates an instance of EdgeProperty which is likely to be used.

createDefaultOneToOneEdgeProperty() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig

This is a convenience method for the typical usage of this edge, and creates an instance of EdgeProperty which is likely to be used.

createValuesIterator() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

D

done() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

done() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder

done() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder

done() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.SpecificBuilder

done() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificBuilder

F

FetcherReadTimeoutException - Exception in org.apache.tez.runtime.library.exceptions

FetcherReadTimeoutException() - Constructor for exception org.apache.tez.runtime.library.exceptions.FetcherReadTimeoutException

FetcherReadTimeoutException(String) - Constructor for exception org.apache.tez.runtime.library.exceptions.FetcherReadTimeoutException

FetcherReadTimeoutException(Throwable) - Constructor for exception org.apache.tez.runtime.library.exceptions.FetcherReadTimeoutException

FetcherReadTimeoutException(String, Throwable) - Constructor for exception org.apache.tez.runtime.library.exceptions.FetcherReadTimeoutException

fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig

fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig

fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig

fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig

fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig

G

generateEventsOnClose() - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

generateWeightStrings(int, int, int, int, int, int) - Static method in class org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor

getAllowedPrefixes() - Static method in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

getConf() - Method in class org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor

getConfigurationKeySet() - Static method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

getConfigurationKeySet() - Static method in class org.apache.tez.runtime.library.input.UnorderedKVInput

getConfigurationKeySet() - Static method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

getConfigurationKeySet() - Static method in class org.apache.tez.runtime.library.output.UnorderedKVOutput

getConfigurationKeySet() - Static method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput

getCurrentKey() - Method in class org.apache.tez.runtime.library.api.KeyValueReader

Returns the current key

getCurrentKey() - Method in class org.apache.tez.runtime.library.api.KeyValuesReader

Returns the current key

getCurrentValue() - Method in class org.apache.tez.runtime.library.api.KeyValueReader

Returns the current value

getCurrentValues() - Method in class org.apache.tez.runtime.library.api.KeyValuesReader

Returns an Iterable view of the values associated with the current key

getDeserializer(Class<Writable>) - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization

getInputClassName() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig

getInputClassName() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig

getInputClassName() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig

getInputClassName() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig

getInputHistoryText() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig

getInputHistoryText() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig

getInputHistoryText() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig

getInputKeyComparator() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

getInputPayload() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig

getInputPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig

getInputPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig

getInputs() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor

getMemoryAssigned() - Method in class org.apache.tez.runtime.library.common.MemoryUpdateCallbackHandler

getOtherConfigDefaults() - Static method in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

getOutputClassName() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig

getOutputClassName() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig

getOutputClassName() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig

getOutputHistoryText() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig

getOutputHistoryText() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig

getOutputHistoryText() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig

getOutputPayload() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig

getOutputPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig

getOutputPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig

getOutputs() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor

getPartition(Object, Object, int) - Method in interface org.apache.tez.runtime.library.api.Partitioner

Get partition for given key/value.

getPartition(Object, Object, int) - Method in class org.apache.tez.runtime.library.partitioner.HashPartitioner

getProxy(BytesWritable) - Method in class org.apache.tez.runtime.library.common.comparator.TezBytesComparator

getReader() - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValueInput

Provides a KeyValueReader that iterates over the concatenated input data

getReader() - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValuesInput

Provides a KeyValuesReader that iterates over the concatenated input data

getReader() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

Get a KVReader for the Input.

getReader() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedMergedKVInput

Provides an ordered KeyValuesReader

getReader() - Method in class org.apache.tez.runtime.library.input.UnorderedKVInput

getRuntimeAdditionalConfigKeySet() - Static method in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

getRuntimeConfigKeySet() - Static method in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

getSerializer(Class<Writable>) - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization

getTezRuntimeConfigDefaults() - Static method in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

getWriter() - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

getWriter() - Method in class org.apache.tez.runtime.library.output.UnorderedKVOutput

getWriter() - Method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput

H

handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.input.UnorderedKVInput

handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.output.UnorderedKVOutput

handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput

handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor

HashPartitioner - Class in org.apache.tez.runtime.library.partitioner

Implements a Partitioner that does hash based partitioning

HashPartitioner() - Constructor for class org.apache.tez.runtime.library.partitioner.HashPartitioner

I

initialize() - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

initialize() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

initialize() - Method in class org.apache.tez.runtime.library.input.UnorderedKVInput

initialize() - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

initialize() - Method in class org.apache.tez.runtime.library.output.UnorderedKVOutput

initialize() - Method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput

initialize() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor

InputAlreadyClosedException - Exception in org.apache.tez.runtime.library.exceptions

InputAlreadyClosedException() - Constructor for exception org.apache.tez.runtime.library.exceptions.InputAlreadyClosedException

InputAlreadyClosedException(Throwable) - Constructor for exception org.apache.tez.runtime.library.exceptions.InputAlreadyClosedException

InputAlreadyClosedException(String, Throwable) - Constructor for exception org.apache.tez.runtime.library.exceptions.InputAlreadyClosedException

inputs - Variable in class org.apache.tez.runtime.library.processor.SimpleProcessor

isInputReady() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

Check if the input is ready for consumption

K

KeyValueReader - Class in org.apache.tez.runtime.library.api

A key/value(s) pair based Reader.

KeyValueReader() - Constructor for class org.apache.tez.runtime.library.api.KeyValueReader

KeyValuesReader - Class in org.apache.tez.runtime.library.api

A key/value(s) pair based Reader.

KeyValuesReader() - Constructor for class org.apache.tez.runtime.library.api.KeyValuesReader

KeyValuesWriter - Class in org.apache.tez.runtime.library.api

key/value(s) based KeyValueWriter

KeyValuesWriter() - Constructor for class org.apache.tez.runtime.library.api.KeyValuesWriter

KeyValueWriter - Class in org.apache.tez.runtime.library.api

A key/value(s) pair based Writer

KeyValueWriter() - Constructor for class org.apache.tez.runtime.library.api.KeyValueWriter

M

memoryAssigned(long) - Method in class org.apache.tez.runtime.library.common.MemoryUpdateCallbackHandler

MemoryUpdateCallbackHandler - Class in org.apache.tez.runtime.library.common

MemoryUpdateCallbackHandler() - Constructor for class org.apache.tez.runtime.library.common.MemoryUpdateCallbackHandler

memoryUpdateCallbackHandler - Variable in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

memoryUpdateCallbackHandler - Variable in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

N

newBuilder(String, String) - Static method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig

newBuilder(String, String, String, Map<String, String>) - Static method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig

Create a builder to configure the relevant Input and Output.

newBuilder(String, String, String) - Static method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig

Create a builder to configure the relevant Input and Output

newBuilder(String, String, String) - Static method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig

newBuilder(String, String, String, Map<String, String>) - Static method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig

newBuilder(String, String) - Static method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig

Create a builder to configure the relevant Input and Output

newBuilder(String, String) - Static method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig

newBuilder(String, String) - Static method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig

newBuilder(String, String, String, Map<String, String>) - Static method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig

Create a builder to configure the relevant Input and Output.

newBuilder(String, String, String) - Static method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig

Create a builder to configure the relevant Input and Output

newBuilder(String, String, String) - Static method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig

newBuilder(String, String, String, Map<String, String>) - Static method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig

next() - Method in class org.apache.tez.runtime.library.api.KeyValueReader

Moves to the next key/values(s) pair

next() - Method in class org.apache.tez.runtime.library.api.KeyValuesReader

Moves to the next key/values(s) pair

O

onRootVertexInitialized(String, InputDescriptor, List<Event>) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

onSourceTaskCompleted(String, Integer) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

onVertexManagerEventReceived(VertexManagerEvent) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

onVertexStarted(Map<String, List<Integer>>) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

onVertexStateUpdated(VertexStateUpdate) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

OrderedGroupedKVInput - Class in org.apache.tez.runtime.library.input

OrderedGroupedKVInput in a AbstractLogicalInput which shuffles intermediate sorted data, merges them and provides key/ to the consumer.

OrderedGroupedKVInput(InputContext, int) - Constructor for class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

OrderedGroupedKVInputConfig - Class in org.apache.tez.runtime.library.conf

OrderedGroupedKVInputConfig.Builder - Class in org.apache.tez.runtime.library.conf

OrderedGroupedKVInputConfig.SpecificBuilder<E extends org.apache.tez.runtime.library.conf.HadoopKeyValuesBasedBaseEdgeConfig.Builder> - Class in org.apache.tez.runtime.library.conf

OrderedGroupedMergedKVInput - Class in org.apache.tez.runtime.library.input

A MergedLogicalInput which merges multiple OrderedGroupedKVInputs and returns a single view of these by merging values which belong to the same key.

OrderedGroupedMergedKVInput(MergedInputContext, List<Input>) - Constructor for class org.apache.tez.runtime.library.input.OrderedGroupedMergedKVInput

OrderedPartitionedKVEdgeConfig - Class in org.apache.tez.runtime.library.conf

Configure payloads for the OrderedPartitionedKVOutput and OrderedGroupedKVInput pair

OrderedPartitionedKVEdgeConfig.Builder - Class in org.apache.tez.runtime.library.conf

OrderedPartitionedKVOutput - Class in org.apache.tez.runtime.library.output

OrderedPartitionedKVOutput is an AbstractLogicalOutput which sorts key/value pairs written to it.

OrderedPartitionedKVOutput(OutputContext, int) - Constructor for class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

OrderedPartitionedKVOutputConfig - Class in org.apache.tez.runtime.library.conf

OrderedPartitionedKVOutputConfig.Builder - Class in org.apache.tez.runtime.library.conf

OrderedPartitionedKVOutputConfig.SpecificBuilder<E extends org.apache.tez.runtime.library.conf.HadoopKeyValuesBasedBaseEdgeConfig.Builder> - Class in org.apache.tez.runtime.library.conf

org.apache.hadoop.io - package org.apache.hadoop.io

org.apache.tez.dag.library.vertexmanager - package org.apache.tez.dag.library.vertexmanager

org.apache.tez.runtime.library.api - package org.apache.tez.runtime.library.api

org.apache.tez.runtime.library.broadcast.output - package org.apache.tez.runtime.library.broadcast.output

org.apache.tez.runtime.library.common - package org.apache.tez.runtime.library.common

org.apache.tez.runtime.library.common.combine - package org.apache.tez.runtime.library.common.combine

org.apache.tez.runtime.library.common.comparator - package org.apache.tez.runtime.library.common.comparator

org.apache.tez.runtime.library.common.localshuffle - package org.apache.tez.runtime.library.common.localshuffle

org.apache.tez.runtime.library.common.readers - package org.apache.tez.runtime.library.common.readers

org.apache.tez.runtime.library.common.security - package org.apache.tez.runtime.library.common.security

org.apache.tez.runtime.library.common.serializer - package org.apache.tez.runtime.library.common.serializer

org.apache.tez.runtime.library.conf - package org.apache.tez.runtime.library.conf

Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.

org.apache.tez.runtime.library.exceptions - package org.apache.tez.runtime.library.exceptions

org.apache.tez.runtime.library.hadoop.compat - package org.apache.tez.runtime.library.hadoop.compat

org.apache.tez.runtime.library.input - package org.apache.tez.runtime.library.input

Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.

org.apache.tez.runtime.library.output - package org.apache.tez.runtime.library.output

Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.

org.apache.tez.runtime.library.partitioner - package org.apache.tez.runtime.library.partitioner

org.apache.tez.runtime.library.processor - package org.apache.tez.runtime.library.processor

org.apache.tez.runtime.library.resources - package org.apache.tez.runtime.library.resources

org.apache.tez.runtime.library.shuffle.impl - package org.apache.tez.runtime.library.shuffle.impl

org.apache.tez.runtime.library.utils - package org.apache.tez.runtime.library.utils

outputs - Variable in class org.apache.tez.runtime.library.processor.SimpleProcessor

P

Partitioner - Interface in org.apache.tez.runtime.library.api

Partitioner is used by the TEZ framework to partition output key/value pairs.

postOp() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor

Called after SimpleProcessor.run() is called and can be used to do post-processing like committing output etc

preOp() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor

Implements input/output initialization.

PreWarmProcessor - Class in org.apache.tez.runtime.library.processor

Built-in convenience Processor to be used for pre-warming.

PreWarmProcessor(ProcessorContext) - Constructor for class org.apache.tez.runtime.library.processor.PreWarmProcessor

preWarmTezCode() - Method in class org.apache.tez.runtime.library.processor.PreWarmProcessor

Pre-warm Tez code.

preWarmUserCode() - Method in class org.apache.tez.runtime.library.processor.PreWarmProcessor

Pre-warm user code.

R

rawIter - Variable in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

run() - Method in class org.apache.tez.runtime.library.processor.PreWarmProcessor

run(Map<String, LogicalInput>, Map<String, LogicalOutput>) - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor

run() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor

Users must implement this method to provide the main application logic code

S

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.SpecificBuilder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.SpecificBuilder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder

setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificBuilder

setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificBuilder

setAvailableBufferSize(int) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder

setAvailableBufferSize(int) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificBuilder

setCombiner(String) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setCombiner(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setCombiner(String) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

setCombiner(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

setCombiner(String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

setCombiner(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

setCombiner(String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder

setCombiner(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder

setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder

setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder

setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder

setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder

setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder

setConf(Configuration) - Method in class org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor

setConstituentInputIsReady(Input) - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValueInput

setConstituentInputIsReady(Input) - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValuesInput

setConstituentInputIsReady(Input) - Method in class org.apache.tez.runtime.library.input.OrderedGroupedMergedKVInput

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.SpecificBuilder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder

setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificBuilder

setKeyComparatorClass(String) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

Set the key comparator class

setKeyComparatorClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

Set the key comparator class and it's associated configuration.

setKeyComparatorClass(String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

Set the key comparator class

setKeyComparatorClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

Set the key comparator class and it's associated configuration.

setKeyComparatorClass(String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

Set the key comparator class

setKeyComparatorClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

Set the key comparator class and it's associated configuration.

setKeySerializationClass(String, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

Set serialization class and the relevant comparator to be used for sorting.

setKeySerializationClass(String, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

Set serialization class and the relevant comparator to be used for sorting.

setKeySerializationClass(String, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

Set serialization class and the relevant comparator to be used for sorting.

setKeySerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder

Set serialization class responsible for providing serializer/deserializer for key/value and the corresponding comparator class to be used as key comparator.

setKeySerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder

Set serialization class responsible for providing serializer/deserializer for key/value and the corresponding comparator class to be used as key comparator.

setKeySerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder

Set serialization class responsible for providing serializer/deserializer for keys.

setKeySerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder

Set serialization class responsible for providing serializer/deserializer for keys.

setKeySerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder

Set serialization class responsible for providing serializer/deserializer for keys.

setMaxSingleMemorySegmentFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setMaxSingleMemorySegmentFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

setMaxSingleMemorySegmentFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder

setMaxSingleMemorySegmentFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder

setMemToMemMerger(boolean) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setMemToMemMerger(boolean) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

setMergeFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setMergeFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

setMergeFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder

setMergeFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder

setPostMergeBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setPostMergeBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

setShuffleBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

setShuffleBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

setShuffleBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder

setShuffleBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder

setSortBufferSize(int) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

setSortBufferSize(int) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder

setSorterNumThreads(int) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

setSorterNumThreads(int) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder

setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

Serialization class to be used for serializing values.

setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder

Set serialization class responsible for providing serializer/deserializer for values.

setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder

Set serialization class responsible for providing serializer/deserializer for values.

setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder

Set serialization class responsible for providing serializer/deserializer for values.

setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder

Set serialization class responsible for providing serializer/deserializer for values.

setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder

Set serialization class responsible for providing serializer/deserializer for values.

setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder

Set serialization class responsible for providing serializer/deserializer for values.

setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder

Set serialization class responsible for providing serializer/deserializer for values.

shuffle - Variable in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

ShuffleVertexManager - Class in org.apache.tez.dag.library.vertexmanager

Starts scheduling tasks when number of completed source tasks crosses slowStartMinSrcCompletionFraction and schedules all tasks when slowStartMaxSrcCompletionFraction is reached

ShuffleVertexManager(VertexManagerPluginContext) - Constructor for class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

SimpleProcessor - Class in org.apache.tez.runtime.library.processor

Implements an AbstractLogicalIOProcessor and provides empty implementations of most methods and handles input/output initialization.

SimpleProcessor(ProcessorContext) - Constructor for class org.apache.tez.runtime.library.processor.SimpleProcessor

sorter - Variable in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

start() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

start() - Method in class org.apache.tez.runtime.library.input.UnorderedKVInput

start() - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

start() - Method in class org.apache.tez.runtime.library.output.UnorderedKVOutput

start() - Method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput

T

TEZ_RUNTIME_COMBINE_MIN_SPILLS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_COMBINE_MIN_SPILLS_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_COMBINER_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

Specifies a combiner class (primarily for Shuffle)

TEZ_RUNTIME_COMPRESS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_COMPRESS_CODEC - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_CONVERT_USER_PAYLOAD_TO_HISTORY_TEXT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

Value: Boolean Whether to publish configuration information to History logger.

TEZ_RUNTIME_CONVERT_USER_PAYLOAD_TO_HISTORY_TEXT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_EMPTY_PARTITION_INFO_VIA_EVENTS_ENABLED - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_EMPTY_PARTITION_INFO_VIA_EVENTS_ENABLED_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_GROUP_COMPARATOR_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_IFILE_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_IFILE_READAHEAD - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

Configuration key to enable/disable IFile readahead.

TEZ_RUNTIME_IFILE_READAHEAD_BYTES - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

Configuration key to set the IFile readahead length in bytes.

TEZ_RUNTIME_IFILE_READAHEAD_BYTES_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_IFILE_READAHEAD_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_INDEX_CACHE_MEMORY_LIMIT_BYTES - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_INDEX_CACHE_MEMORY_LIMIT_BYTES_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_INPUT_BUFFER_PERCENT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_INPUT_POST_MERGE_BUFFER_PERCENT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_INTERNAL_SORTER_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_IO_FILE_BUFFER_SIZE - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

This is copy of io.file.buffer.size from Hadoop, which is used in several places such as compression codecs, buffer sizes in IFile, while fetching etc.

TEZ_RUNTIME_IO_SORT_FACTOR - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_IO_SORT_FACTOR_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_IO_SORT_MB - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_IO_SORT_MB_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_KEY_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_KEY_COMPARATOR_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_KEY_SECONDARY_COMPARATOR_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_OPTIMIZE_LOCAL_FETCH - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

If the shuffle input is on the local host bypass the http fetch and access the files directly

TEZ_RUNTIME_OPTIMIZE_LOCAL_FETCH_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

local mode bypassing the http fetch is not enabled by default till we have unit tests in.

TEZ_RUNTIME_OPTIMIZE_SHARED_FETCH - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

Share data fetched between tasks running on the same host if applicable

TEZ_RUNTIME_OPTIMIZE_SHARED_FETCH_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

shared mode bypassing the http fetch is not enabled by default till we have unit tests in.

TEZ_RUNTIME_PARTITIONER_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

Specifies a partitioner class, which is used in Tez Runtime components like OnFileSortedOutput

TEZ_RUNTIME_RECORDS_BEFORE_PROGRESS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_RECORDS_BEFORE_PROGRESS_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_BUFFER_SIZE - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_CONNECT_TIMEOUT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_ENABLE_MEMTOMEM - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_ENABLE_MEMTOMEM_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_ENABLE_SSL - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_ENABLE_SSL_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_FETCH_BUFFER_PERCENT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_FETCH_BUFFER_PERCENT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_FETCH_FAILURES_LIMIT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_FETCH_FAILURES_LIMIT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_FETCH_MAX_TASK_OUTPUT_AT_ONCE - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_FETCH_MAX_TASK_OUTPUT_AT_ONCE_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_KEEP_ALIVE_ENABLED - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_KEEP_ALIVE_ENABLED_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_KEEP_ALIVE_MAX_CONNECTIONS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_KEEP_ALIVE_MAX_CONNECTIONS_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_MEMORY_LIMIT_PERCENT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_MEMORY_LIMIT_PERCENT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_MEMTOMEM_SEGMENTS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_MERGE_PERCENT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_MERGE_PERCENT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_NOTIFY_READERROR - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_NOTIFY_READERROR_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_PARALLEL_COPIES - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_PARALLEL_COPIES_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_READ_TIMEOUT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_READ_TIMEOUT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SHUFFLE_STALLED_COPY_TIMEOUT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SORT_SPILL_PERCENT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SORT_SPILL_PERCENT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SORT_THREADS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_SORT_THREADS_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_TRANSFER_DATA_VIA_EVENTS_ENABLED - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_TRANSFER_DATA_VIA_EVENTS_ENABLED_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_TRANSFER_DATA_VIA_EVENTS_MAX_SIZE - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_TRANSFER_DATA_VIA_EVENTS_MAX_SIZE_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_UNORDERED_OUTPUT_BUFFER_SIZE_MB - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

Size of the buffer to use if not writing directly to disk.

TEZ_RUNTIME_UNORDERED_OUTPUT_BUFFER_SIZE_MB_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_RUNTIME_UNORDERED_OUTPUT_MAX_PER_BUFFER_SIZE_BYTES - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

Maximum size for individual buffers used in the UnsortedPartitionedOutput.

TEZ_RUNTIME_VALUE_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

TEZ_SHUFFLE_VERTEX_MANAGER_DESIRED_TASK_INPUT_SIZE - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

The desired size of input per task.

TEZ_SHUFFLE_VERTEX_MANAGER_DESIRED_TASK_INPUT_SIZE_DEFAULT - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

TEZ_SHUFFLE_VERTEX_MANAGER_ENABLE_AUTO_PARALLEL - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

Enables automatic parallelism determination for the vertex.

TEZ_SHUFFLE_VERTEX_MANAGER_ENABLE_AUTO_PARALLEL_DEFAULT - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

TEZ_SHUFFLE_VERTEX_MANAGER_MAX_SRC_FRACTION - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

In case of a ScatterGather connection, once this fraction of source tasks have completed, all tasks on the current vertex can be scheduled.

TEZ_SHUFFLE_VERTEX_MANAGER_MAX_SRC_FRACTION_DEFAULT - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

TEZ_SHUFFLE_VERTEX_MANAGER_MIN_SRC_FRACTION - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

In case of a ScatterGather connection, the fraction of source tasks which should complete before tasks for the current vertex are scheduled

TEZ_SHUFFLE_VERTEX_MANAGER_MIN_SRC_FRACTION_DEFAULT - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

TEZ_SHUFFLE_VERTEX_MANAGER_MIN_TASK_PARALLELISM - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

Automatic parallelism determination will not decrease parallelism below this value

TEZ_SHUFFLE_VERTEX_MANAGER_MIN_TASK_PARALLELISM_DEFAULT - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager

TezBytesComparator - Class in org.apache.tez.runtime.library.common.comparator

TezBytesComparator() - Constructor for class org.apache.tez.runtime.library.common.comparator.TezBytesComparator

TezBytesWritableSerialization - Class in org.apache.tez.runtime.library.common.serializer

When using BytesWritable, data is serialized in memory (4 bytes per key and 4 bytes per value) and written to IFile where it gets serialized again (4 bytes per key and 4 bytes per value).

TezBytesWritableSerialization() - Constructor for class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization

TezRuntimeConfiguration - Class in org.apache.tez.runtime.library.api

Meant for user configurable job properties.

TezRuntimeConfiguration() - Constructor for class org.apache.tez.runtime.library.api.TezRuntimeConfiguration

toUserPayload() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig

Get a UserPayload representation of the Configuration

toUserPayload() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig

Get a UserPayload representation of the Configuration

toUserPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig

Get a UserPayload representation of the Configuration

toUserPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig

Get a UserPayload representation of the Configuration

toUserPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig

Get a UserPayload representation of the Configuration

U

UnorderedKVEdgeConfig - Class in org.apache.tez.runtime.library.conf

Configure payloads for the UnorderedKVOutput and UnorderedKVInput pair

UnorderedKVEdgeConfig.Builder - Class in org.apache.tez.runtime.library.conf

UnorderedKVInput - Class in org.apache.tez.runtime.library.input

UnorderedKVInput provides unordered key value input by bringing together (shuffling) a set of distributed data and providing a unified view to that data.

UnorderedKVInput(InputContext, int) - Constructor for class org.apache.tez.runtime.library.input.UnorderedKVInput

UnorderedKVInputConfig - Class in org.apache.tez.runtime.library.conf

UnorderedKVInputConfig.Builder - Class in org.apache.tez.runtime.library.conf

UnorderedKVInputConfig.SpecificBuilder<E extends org.apache.tez.runtime.library.conf.HadoopKeyValuesBasedBaseEdgeConfig.Builder> - Class in org.apache.tez.runtime.library.conf

UnorderedKVOutput - Class in org.apache.tez.runtime.library.output

UnorderedKVOutput is a LogicalOutput that writes key value data without applying any ordering or grouping constraints.

UnorderedKVOutput(OutputContext, int) - Constructor for class org.apache.tez.runtime.library.output.UnorderedKVOutput

UnorderedKVOutputConfig - Class in org.apache.tez.runtime.library.conf

UnorderedKVOutputConfig.Builder - Class in org.apache.tez.runtime.library.conf

UnorderedKVOutputConfig.SpecificBuilder<E extends org.apache.tez.runtime.library.conf.HadoopKeyValuesBasedBaseEdgeConfig.Builder> - Class in org.apache.tez.runtime.library.conf

UnorderedPartitionedKVEdgeConfig - Class in org.apache.tez.runtime.library.conf

Configure payloads for the UnorderedPartitionedKVOutput and UnorderedKVInput pair

UnorderedPartitionedKVEdgeConfig.Builder - Class in org.apache.tez.runtime.library.conf

UnorderedPartitionedKVOutput - Class in org.apache.tez.runtime.library.output

UnorderedPartitionedKVOutput is a LogicalOutput which can be used to write Key-Value pairs.

UnorderedPartitionedKVOutput(OutputContext, int) - Constructor for class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput

UnorderedPartitionedKVOutputConfig - Class in org.apache.tez.runtime.library.conf

UnorderedPartitionedKVOutputConfig.Builder - Class in org.apache.tez.runtime.library.conf

UnorderedPartitionedKVOutputConfig.SpecificBuilder<E extends org.apache.tez.runtime.library.conf.HadoopKeyValuesBasedBaseEdgeConfig.Builder> - Class in org.apache.tez.runtime.library.conf

useLegacyInput() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder

useLegacyInput() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder

V

validateUpdateReceived() - Method in class org.apache.tez.runtime.library.common.MemoryUpdateCallbackHandler

vIter - Variable in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

W

waitForInputReady() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput

Waits for the input to become ready for consumption

WeightedScalingMemoryDistributor - Class in org.apache.tez.runtime.library.resources

Distributes memory between various requesting components by applying a weighted scaling function.

WeightedScalingMemoryDistributor() - Constructor for class org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor

write(Object, Iterable<Object>) - Method in class org.apache.tez.runtime.library.api.KeyValuesWriter

Writes a key and its associated values

write(Object, Object) - Method in class org.apache.tez.runtime.library.api.KeyValueWriter

Writes a key/value pair.

A B C D F G H I K M N O P R S T U V W