org.apache.tez.runtime.library.output

Class OrderedPartitionedKVOutput

java.lang.Object

org.apache.tez.runtime.api.AbstractLogicalOutput

org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput

All Implemented Interfaces:

org.apache.tez.runtime.api.LogicalOutput, org.apache.tez.runtime.api.LogicalOutputFrameworkInterface, org.apache.tez.runtime.api.Output, org.apache.tez.runtime.api.OutputFrameworkInterface

@InterfaceAudience.Public
public class OrderedPartitionedKVOutput
extends org.apache.tez.runtime.api.AbstractLogicalOutput

OrderedPartitionedKVOutput is an AbstractLogicalOutput which sorts key/value pairs written to it. It also partitions the output based on a Partitioner

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.conf.Configuration	conf
protected MemoryUpdateCallbackHandler	memoryUpdateCallbackHandler
protected org.apache.tez.runtime.library.common.sort.impl.ExternalSorter	sorter

Constructor Summary

Constructors

Constructor and Description
OrderedPartitionedKVOutput(org.apache.tez.runtime.api.OutputContext outputContext, int numPhysicalOutputs)

Method Summary

Methods

Modifier and Type	Method and Description
List<org.apache.tez.runtime.api.Event>	close()
protected List<org.apache.tez.runtime.api.Event>	generateEventsOnClose()
KeyValuesWriter	getWriter()
void	handleEvents(List<org.apache.tez.runtime.api.Event> outputEvents)
List<org.apache.tez.runtime.api.Event>	initialize()
void	start()

Methods inherited from class org.apache.tez.runtime.api.AbstractLogicalOutput

getContext, getNumPhysicalOutputs

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sorter

protected org.apache.tez.runtime.library.common.sort.impl.ExternalSorter sorter

conf

protected org.apache.hadoop.conf.Configuration conf

memoryUpdateCallbackHandler

protected MemoryUpdateCallbackHandler memoryUpdateCallbackHandler

Constructor Detail

OrderedPartitionedKVOutput

public OrderedPartitionedKVOutput(org.apache.tez.runtime.api.OutputContext outputContext,
                          int numPhysicalOutputs)

Method Detail

initialize

public List<org.apache.tez.runtime.api.Event> initialize()
                                                  throws IOException

Specified by:

initialize in interface org.apache.tez.runtime.api.OutputFrameworkInterface

Specified by:

initialize in class org.apache.tez.runtime.api.AbstractLogicalOutput

Throws:

IOException

start

public void start()
           throws Exception

Throws:

Exception

getWriter

public KeyValuesWriter getWriter()
                          throws IOException

Throws:

IOException

handleEvents

public void handleEvents(List<org.apache.tez.runtime.api.Event> outputEvents)

close

public List<org.apache.tez.runtime.api.Event> close()
                                             throws IOException

Throws:

IOException

generateEventsOnClose

protected List<org.apache.tez.runtime.api.Event> generateEventsOnClose()
                                                                throws IOException

Throws:

IOException