org.apache.tez.runtime.library.common.shuffle

Class LocalDiskFetchedInput

java.lang.Object

org.apache.tez.runtime.library.common.shuffle.FetchedInput

org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput

public class LocalDiskFetchedInput
extends FetchedInput

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.tez.runtime.library.common.shuffle.FetchedInput

FetchedInput.State, FetchedInput.Type

Field Summary

Fields inherited from class org.apache.tez.runtime.library.common.shuffle.FetchedInput

actualSize, callback, compressedSize, id, inputAttemptIdentifier, state, type

Constructor Summary

Constructors

Constructor and Description
LocalDiskFetchedInput(long startOffset, long actualSize, long compressedSize, InputAttemptIdentifier inputAttemptIdentifier, org.apache.hadoop.fs.Path inputFile, org.apache.hadoop.conf.Configuration conf, FetchedInputCallback callbackHandler)

Method Summary

Methods

Modifier and Type	Method and Description
void	abort() Abort the output.
void	commit() Commit the output.
void	free() Called when this input has been consumed, so that resources can be reclaimed.
protected org.apache.hadoop.fs.Path	getInputFile()
InputStream	getInputStream() Return an input stream to be used to read the previously fetched data.
protected org.apache.hadoop.fs.FileSystem	getLocalFS()
OutputStream	getOutputStream() Returns the output stream to be used to write fetched data.
protected long	getStartOffset()
String	toString()

Methods inherited from class org.apache.tez.runtime.library.common.shuffle.FetchedInput

equals, getActualSize, getCompressedSize, getInputAttemptIdentifier, getType, hashCode, notifyFetchComplete, notifyFetchFailure, notifyFreedResource

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

LocalDiskFetchedInput

public LocalDiskFetchedInput(long startOffset,
                     long actualSize,
                     long compressedSize,
                     InputAttemptIdentifier inputAttemptIdentifier,
                     org.apache.hadoop.fs.Path inputFile,
                     org.apache.hadoop.conf.Configuration conf,
                     FetchedInputCallback callbackHandler)
                      throws IOException

Throws:

IOException

Method Detail

getOutputStream

public OutputStream getOutputStream()
                             throws IOException

Description copied from class: FetchedInput

Returns the output stream to be used to write fetched data. Users are expected to close the OutputStream when they're done

Specified by:

getOutputStream in class FetchedInput

Throws:

IOException

getInputStream

public InputStream getInputStream()
                           throws IOException

Description copied from class: FetchedInput

Return an input stream to be used to read the previously fetched data. All calls to getInputStream() produce new reset streams for reading. Users are expected to close the InputStream when they're done.

Specified by:

getInputStream in class FetchedInput

Throws:

IOException

commit

public void commit()

Description copied from class: FetchedInput

Commit the output. Should be idempotent

Specified by:

commit in class FetchedInput

abort

public void abort()

Description copied from class: FetchedInput

Abort the output. Should be idempotent

Specified by:

abort in class FetchedInput

free

public void free()

Description copied from class: FetchedInput

Called when this input has been consumed, so that resources can be reclaimed.

Specified by:

free in class FetchedInput

toString

public String toString()

Overrides:

toString in class Object

getInputFile

protected org.apache.hadoop.fs.Path getInputFile()

getStartOffset

protected long getStartOffset()

getLocalFS

protected org.apache.hadoop.fs.FileSystem getLocalFS()