Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3821

Ability to fail fast tasks that write too much to local disk

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.3
    • None
    • None

    Description

      It would be nice to have a configurable limit such that any task that wrote data to the local filesystem beyond that limit would fail quickly rather than waiting for the disk to fill much later, impacting other jobs on the cluster.

      This is essentially asking for the Tez version of MAPREDUCE-6489.

      Attachments

        Issue Links

          Activity

            abstractdog László Bodor added a comment -

            merged to master, thanks ayushtkn for the review and rbalamohan for the review!

            abstractdog László Bodor added a comment - merged to master, thanks ayushtkn for the review and rbalamohan for the review!

            People

              ayushtkn Ayush Saxena
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 40m
                  1h 40m