@InterfaceAudience.Public @InterfaceStability.Evolving public static class UnorderedKVInputConfig.SpecificBuilder<E extends org.apache.tez.runtime.library.conf.HadoopKeyValuesBasedBaseEdgeConfig.Builder> extends Object implements org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificConfigBuilder<UnorderedKVInputConfig.SpecificBuilder>
Modifier and Type | Method and Description |
---|---|
E |
done() |
UnorderedKVInputConfig.SpecificBuilder<E> |
setAdditionalConfiguration(Map<String,String> confMap)
Used to set additional configuration parameters which are not set via API methods.
|
UnorderedKVInputConfig.SpecificBuilder<E> |
setAdditionalConfiguration(String key,
String value)
Used to set additional configuration parameters which are not set via API methods.
|
UnorderedKVInputConfig.SpecificBuilder<E> |
setFromConfiguration(org.apache.hadoop.conf.Configuration conf) |
UnorderedKVInputConfig.SpecificBuilder |
setFromConfigurationUnfiltered(org.apache.hadoop.conf.Configuration conf) |
UnorderedKVInputConfig.SpecificBuilder<E> |
setMaxSingleMemorySegmentFraction(float maxSingleSegmentFraction)
Sets a size limit on the maximum segment size to be shuffled to disk.
|
UnorderedKVInputConfig.SpecificBuilder<E> |
setMergeFraction(float mergeFraction)
Configure the point at which in memory segments will be merged and written out to a single
large disk segment.
|
UnorderedKVInputConfig.SpecificBuilder<E> |
setShuffleBufferFraction(float shuffleBufferFraction)
Sets the buffer fraction, as a fraction of container size, to be used while fetching remote
data.
|
public UnorderedKVInputConfig.SpecificBuilder<E> setShuffleBufferFraction(float shuffleBufferFraction)
org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificConfigBuilder
setShuffleBufferFraction
in interface org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificConfigBuilder<UnorderedKVInputConfig.SpecificBuilder>
shuffleBufferFraction
- fraction of container sizepublic UnorderedKVInputConfig.SpecificBuilder<E> setMaxSingleMemorySegmentFraction(float maxSingleSegmentFraction)
org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificConfigBuilder
setMaxSingleMemorySegmentFraction
in interface org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificConfigBuilder<UnorderedKVInputConfig.SpecificBuilder>
maxSingleSegmentFraction
- fraction of memory determined by ShuffleBufferFractionpublic UnorderedKVInputConfig.SpecificBuilder<E> setMergeFraction(float mergeFraction)
org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificConfigBuilder
setMergeFraction
in interface org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificConfigBuilder<UnorderedKVInputConfig.SpecificBuilder>
mergeFraction
- fraction of memory determined by ShuffleBufferFraction, which when
filled, will
trigger a mergepublic UnorderedKVInputConfig.SpecificBuilder<E> setAdditionalConfiguration(String key, String value)
key
- the key to setvalue
- the corresponding valuepublic UnorderedKVInputConfig.SpecificBuilder<E> setAdditionalConfiguration(Map<String,String> confMap)
confMap
- map of configuration key-value pairspublic UnorderedKVInputConfig.SpecificBuilder<E> setFromConfiguration(org.apache.hadoop.conf.Configuration conf)
public UnorderedKVInputConfig.SpecificBuilder setFromConfigurationUnfiltered(org.apache.hadoop.conf.Configuration conf)
public E done()
Copyright © 2024 Apache Software Foundation. All rights reserved.