Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15789

DistCp does not clean staging folder if class extends DistCp

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      My code extends Distcp class and for some reason if distcp fails staging folder is not delete and this staging folder piles up occupying space on hdfs.

      After checking the code i found that cleanup() function is private. Making the cleanup() method as public, user should be able to invoke the cleanup if job fails.

      This works fine with command line argument. But fails only if we extend Distcp class.

      Attachments

        1. HADOOP-15789-01.patch
          1 kB
          Ayush Saxena

        Issue Links

          Activity

            People

              lawpremkumar Lawrence Andrews
              lawpremkumar Lawrence Andrews
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h