Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2951

Progressive allocation of buffers for Unordered Partitioned Output

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Similar to TEZ-2244. In the case of UnorderedPartitionOutput - the default is to use 2 buffers. This can be changed to a higher value when using pipelined shuffle - and have memory allocated only when required.

      Attachments

        Activity

          People

            Unassigned Unassigned
            sseth Siddharth Seth
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: