Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
None
-
Reviewed
Description
My code extends Distcp class and for some reason if distcp fails staging folder is not delete and this staging folder piles up occupying space on hdfs.
After checking the code i found that cleanup() function is private. Making the cleanup() method as public, user should be able to invoke the cleanup if job fails.
This works fine with command line argument. But fails only if we extend Distcp class.
Attachments
Attachments
Issue Links
- is depended upon by
-
HADOOP-15788 Improve Distcp for long-haul/cloud deployments
- Open
- links to