org.apache.tez.runtime.library.conf

Class UnorderedPartitionedKVOutputConfig.Builder

java.lang.Object

org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder

All Implemented Interfaces:

org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificConfigBuilder<UnorderedPartitionedKVOutputConfig.Builder>

Enclosing class:

UnorderedPartitionedKVOutputConfig

@InterfaceAudience.Public
@InterfaceStability.Evolving
public static class UnorderedPartitionedKVOutputConfig.Builder
extends Object
implements org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificConfigBuilder<UnorderedPartitionedKVOutputConfig.Builder>

Method Summary

Methods

Modifier and Type	Method and Description
UnorderedPartitionedKVOutputConfig	build() Create the actual configuration instance.
UnorderedPartitionedKVOutputConfig.Builder	setAdditionalConfiguration(Map<String,String> confMap) Used to set additional configuration parameters which are not set via API methods.
UnorderedPartitionedKVOutputConfig.Builder	setAdditionalConfiguration(String key, String value) Used to set additional configuration parameters which are not set via API methods.
UnorderedPartitionedKVOutputConfig.Builder	setAvailableBufferSize(int availableBufferSize) Set the buffer size to use
UnorderedPartitionedKVOutputConfig.Builder	setCompression(boolean enabled, String compressionCodec, Map<String,String> codecConf)
UnorderedPartitionedKVOutputConfig.Builder	setFromConfiguration(org.apache.hadoop.conf.Configuration conf) Used to build out a configuration from an existing Hadoop Configuration.
UnorderedPartitionedKVOutputConfig.Builder	setKeySerializationClass(String serializationClassName, Map<String,String> serializerConf) Set serialization class responsible for providing serializer/deserializer for keys.
UnorderedPartitionedKVOutputConfig.Builder	setValueSerializationClass(String serializationClassName, Map<String,String> serializerConf) Set serialization class responsible for providing serializer/deserializer for values.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

setAvailableBufferSize

public UnorderedPartitionedKVOutputConfig.Builder setAvailableBufferSize(int availableBufferSize)

Description copied from interface: org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificConfigBuilder

Set the buffer size to use

Specified by:

setAvailableBufferSize in interface org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificConfigBuilder<UnorderedPartitionedKVOutputConfig.Builder>

Parameters:

availableBufferSize - the size of the buffer in MB

Returns:

instance of the current builder

setAdditionalConfiguration

public UnorderedPartitionedKVOutputConfig.Builder setAdditionalConfiguration(String key,
                                                                    String value)

Used to set additional configuration parameters which are not set via API methods. This is primarily meant for rarely used configuration options such as IFile read-ahead, configuring the number of parallel files to merge etc.

Parameters:

key - the key to set

value - the corresponding value

Returns:

this object for further chained method calls

setAdditionalConfiguration

public UnorderedPartitionedKVOutputConfig.Builder setAdditionalConfiguration(Map<String,String> confMap)

Used to set additional configuration parameters which are not set via API methods. This is primarily meant for rarely used configuration options such as IFile read-ahead, configuring the number of parallel files to merge etc.

Additionally keys set via this method are made available to the combiner.

Parameters:

confMap - map of configuration key-value pairs

Returns:

this object for further chained method calls

setFromConfiguration

public UnorderedPartitionedKVOutputConfig.Builder setFromConfiguration(org.apache.hadoop.conf.Configuration conf)

Used to build out a configuration from an existing Hadoop Configuration. This is a private API is present only for compatibility and ease of use for existing systems which rely heavily on Configuration.

Returns:

this object for further chained method calls

setCompression

public UnorderedPartitionedKVOutputConfig.Builder setCompression(boolean enabled,
                                                        @Nullable
                                                        String compressionCodec,
                                                        @Nullable
                                                        Map<String,String> codecConf)

setKeySerializationClass

public UnorderedPartitionedKVOutputConfig.Builder setKeySerializationClass(String serializationClassName,
                                                                  @Nullable
                                                                  Map<String,String> serializerConf)

Set serialization class responsible for providing serializer/deserializer for keys.

Parameters:

serializationClassName -

serializerConf - the serializer configuration. This can be null, and is a Map of key-value pairs. The keys should be limited to the ones required by the comparator.

Returns:

this object for further chained method calls

setValueSerializationClass

public UnorderedPartitionedKVOutputConfig.Builder setValueSerializationClass(String serializationClassName,
                                                                    @Nullable
                                                                    Map<String,String> serializerConf)

Set serialization class responsible for providing serializer/deserializer for values.

Parameters:

serializationClassName -

serializerConf - the serializer configuration. This can be null, and is a Map of key-value pairs. The keys should be limited to the ones required by the comparator.

Returns:

this object for further chained method calls

build

public UnorderedPartitionedKVOutputConfig build()

Create the actual configuration instance.

Returns:

an instance of the Configuration