Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3161

Allow task to report different kinds of errors - fatal / kill

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.8.3
    • None
    • None

    Description

      In some cases, task failures will be the same across all attempts - e.g. exceeding memory utilization on an operation. In this case, there's no point in running another attempt of the same task.

      There's other cases where a task may want to mark itself as KILLED - i.e. a temporary error. An example of this is pipelined shuffle.

      Tez should allow both operations.

      cc vikram.dixit, rajesh.balamohan

      Attachments

        1. TEZ-3161.6.txt
          218 kB
          Siddharth Seth
        2. TEZ-3161.5.txt
          219 kB
          Siddharth Seth
        3. TEZ-3161.4.txt
          218 kB
          Siddharth Seth
        4. TEZ-3161.3.txt
          206 kB
          Siddharth Seth
        5. TEZ-3161.2.txt
          206 kB
          Siddharth Seth
        6. TEZ-3161.1.txt
          190 kB
          Siddharth Seth

        Issue Links

          Activity

            People

              sseth Siddharth Seth
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: