Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2657 TaskTracker should handle disk failures
  3. MAPREDUCE-3011

TT should remove bad local dirs from conf to prevent constant disk checking

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Not A Problem
    • 0.20.204.0
    • None
    • tasktracker
    • None

    Description

      Per HADOOP-7551 the TT does not remove bad mapred.local.dirs from the conf so after a single disk failure every call to get a local path for reading or writing results in a disk check of all configured local dirs. After detecting that a local dir is bad we should remove it from the conf so that we don't repeatedly perform this expensive operation.

      Attachments

        Issue Links

          Activity

            People

              eli Eli Collins
              eli Eli Collins
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: