Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-813

map tasks lost during sort

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.10.0
    • 0.10.0
    • None
    • None

    Description

      On a 500 node cluster, I had a bunch of map tasks get "lost" because they failed to report progress for 10 minutes. They appear to be in the sort stage at the end of the map. I hypothesize that the patch for HADOOP-331 does not update the map's progress during the sort/merge. If the sort/merge takes more than 10 minutes, the task is lost.

      Attachments

        1. 813.patch
          7 kB
          Devaraj Das
        2. 813.patch
          7 kB
          Devaraj Das

        Activity

          People

            ddas Devaraj Das
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: