@InterfaceAudience.Public public class DataSinkDescriptor extends Object
Constructor and Description |
---|
DataSinkDescriptor(OutputDescriptor outputDescriptor,
OutputCommitterDescriptor committerDescriptor,
org.apache.hadoop.security.Credentials credentials)
Create a
DataSinkDescriptor |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.security.Credentials |
getCredentials() |
OutputCommitterDescriptor |
getOutputCommitterDescriptor() |
OutputDescriptor |
getOutputDescriptor() |
public DataSinkDescriptor(OutputDescriptor outputDescriptor, @Nullable OutputCommitterDescriptor committerDescriptor, @Nullable org.apache.hadoop.security.Credentials credentials)
DataSinkDescriptor
outputDescriptor
- An OutputDescriptor
for the outputcommitterDescriptor
- Specify a committer to be used for the output. Can be null. After all
tasks in the vertex (or in the DAG) have completed, the committer
(if specified) is invoked to commit the outputs. Commit is a data
sink specific operation that usually determines the visibility of
the output to external observers. E.g. moving output files from
temporary dirs to the real output dir. When there are multiple
executions of a task, the commit process also helps decide which
execution will be included in the final output. Users should
consider whether their application or data sink need a commit
operation.credentials
- Credentials needs to access the data sinkpublic OutputDescriptor getOutputDescriptor()
@Nullable public OutputCommitterDescriptor getOutputCommitterDescriptor()
@Nullable public org.apache.hadoop.security.Credentials getCredentials()
Copyright © 2014 Apache Software Foundation. All rights reserved.