Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-388 Pig on Tez
  3. TEZ-391

SharedEdge - Support for passing same output from a vertex as input to two different vertices

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      We need this for lot of usecases. For cases where multi-query is turned off and for optimizing unions. Currently those are BROADCAST or ONE-ONE edges and we write the output multiple times.

      Attachments

        1. TEZ-391-WIP-7.patch
          100 kB
          Jeff Zhang
        2. TEZ-391-WIP-6.patch
          84 kB
          Jeff Zhang
        3. TEZ-391-WIP-5.patch
          84 kB
          Jeff Zhang
        4. TEZ-391-WIP-4.patch
          87 kB
          Jeff Zhang
        5. Shared Edge Design.pdf
          270 kB
          Jeff Zhang
        6. TEZ-391-WIP-3.patch
          63 kB
          Jeff Zhang
        7. TEZ-391-WIP-2.patch
          62 kB
          Jeff Zhang
        8. TEZ-391-WIP-1.patch
          27 kB
          Jeff Zhang

        Issue Links

          is required by

          Sub-task - The sub-task of the issue PIG-3845 Use shared edge with no multiquery

          • Major - Major loss of function.
          • Open

          Sub-task - The sub-task of the issue PIG-3856 UnionOptimizer in Tez should optimize the case of replicated join

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. TEZ-388 Pig on Tez

          • Major - Major loss of function.
          • Open

          Activity

            People

              zjffdu Jeff Zhang
              rohini Rohini Palaniswamy
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated: