|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.mapreduce.OutputCommitter
org.apache.hadoop.mapred.OutputCommitter
org.apache.hadoop.mapred.FileOutputCommitter
public class FileOutputCommitter
An OutputCommitter
that commits files specified
in job output directory i.e. ${mapred.output.dir}.
Field Summary | |
---|---|
static org.apache.commons.logging.Log |
LOG
|
static String |
TEMP_DIR_NAME
Temporary directory name |
Constructor Summary | |
---|---|
FileOutputCommitter()
|
Method Summary | |
---|---|
void |
abortTask(TaskAttemptContext context)
Discard the task output |
void |
cleanupJob(JobContext context)
For cleaning up the job's output after job completion |
void |
commitTask(TaskAttemptContext context)
To promote the task's temporary output to final output location The task's output is moved to the job's output directory. |
boolean |
needsTaskCommit(TaskAttemptContext context)
Check whether task needs a commit |
void |
setupJob(JobContext context)
For the framework to setup the job output during initialization |
void |
setupTask(TaskAttemptContext context)
Sets up output for the task. |
Methods inherited from class org.apache.hadoop.mapred.OutputCommitter |
---|
abortTask, cleanupJob, commitTask, needsTaskCommit, setupJob, setupTask |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
public static final org.apache.commons.logging.Log LOG
public static final String TEMP_DIR_NAME
Constructor Detail |
---|
public FileOutputCommitter()
Method Detail |
---|
public void setupJob(JobContext context) throws IOException
OutputCommitter
setupJob
in class OutputCommitter
context
- Context of the job whose output is being written.
IOException
- if temporary output could not be createdpublic void cleanupJob(JobContext context) throws IOException
OutputCommitter
cleanupJob
in class OutputCommitter
context
- Context of the job whose output is being written.
IOException
public void setupTask(TaskAttemptContext context) throws IOException
OutputCommitter
setupTask
in class OutputCommitter
context
- Context of the task whose output is being written.
IOException
public void commitTask(TaskAttemptContext context) throws IOException
OutputCommitter
commitTask
in class OutputCommitter
context
- Context of the task whose output is being written.
IOException
- if commit is notpublic void abortTask(TaskAttemptContext context) throws IOException
OutputCommitter
abortTask
in class OutputCommitter
IOException
public boolean needsTaskCommit(TaskAttemptContext context) throws IOException
OutputCommitter
needsTaskCommit
in class OutputCommitter
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |