Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-803 Fault Tolerance In Tez
  3. TEZ-806

Ensure appropriate number of data movement events are generated by a task

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      For every outgoing edge of a vertex, tasks need to produce data movement events for consumers. If a task does not produce a data movement event then the job will hang since the consumer task will be stuck waiting for input.
      Additionally, if possible, we should check that the appropriate number of events have been produced. This may need enhancements to the edge manager API for custom edges.

      Attachments

        Activity

          People

            Unassigned Unassigned
            bikassaha Bikas Saha
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: