Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
None
-
None
-
None
-
None
Description
LocalJobRunner uses the "mapred.output.committer.class" configuration property to retrieve the output committer for the job, which can be different from the Output Committer returned from OutputFormat.getOutputCommitter(TaskAttemptContext context). So, two different output committers can be used in the same job.
See line 324 in org.apache.hadoop.mapred.LocalJobRunner: OutputCommitter outputCommitter = job.getOutputCommitter();
Need to modify this behavior to check if the new or the old API is used, and then return the correct output committer.
Attachments
Attachments
Issue Links
- is duplicated by
-
MAPREDUCE-3563 LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitter
- Closed