Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6669

Jobs with encrypted spills don't tolerate AM failures

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • 2.8.0
    • None
    • mr-am
    • None

    Description

      The key used for encrypting intermediate data is not persisted anywhere, and hence can't be recovered the same way other MR jobs can be. We should support recovering these jobs as well, hopefully without having to re-run completed tasks.

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6638 Do not attempt to recover progress from previous job attempts if spill encryption is enabled

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              haibochen Haibo Chen
              kasha Karthik Kambatla
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: