Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1227

Allow JobTracker to pause task scheduling

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 0.22.0
    • None
    • None
    • None

    Description

      We want to have an ability to pause task scheduling in JobTracker.

      The idea is: make job tracker still accept new jobs, but delay their running and do not schedule any new tasks from the currently running jobs.

      It will help for example restarting the DFS cluster without affecting jobs: pause execution, restart the DFS, running tasks will fail, but will not be scheduled until the execution is resumed, so the job does not fail.

      In general it should help fix non MR problems (DFS, network, etc.) while not failing running jobs and keep accepting new ones.

      What do people think of the general idea?

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              dms Dmytro Molkov
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: