Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1052

Optimize implementation of CompositeShuffledMergedInput

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Currently CompositeShuffledMergedInput which is used with vertex groups is a naive implementation that just merges multiple shuffle inputs. The implementation needs to be changed to a more advanced one that takes advantage of the underlying structures instead of just merging already merged Inputs for efficiency and better performance.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rohini Rohini Palaniswamy
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: