Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1386

Users should not need to setup TezGroupedInputFormat to enable grouping

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.5.0
    • None
    • None

    Description

      To enable grouping via Tez, users should not need to change the underlying InputFormat. A simple enable / disable option should be sufficient.
      MRInputConfigurer does this.
      Many of the methods in MRHelpers, however, require an InputFormat to be specified. The main objective of this JIRA is to get rid of this requirement in favor of a simple enableGrouping flag.
      Marking this as a blocker for TEZ-1347, since it should simplify the set of APIs required. Also, making all the changes in TEZ-1347 would just lead to a very large patch.

      Attachments

        1. TEZ-1386.1.txt
          46 kB
          Siddharth Seth
        2. TEZ-1386.2.txt
          40 kB
          Siddharth Seth
        3. TEZ-1386.3.txt
          41 kB
          Siddharth Seth

        Issue Links

          blocks

          Sub-task - The sub-task of the issue TEZ-1347 Consolidate MRHelpers

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          breaks

          Bug - A problem which impairs or prevents the functions of the product. PIG-4113 TEZ-1386 breaks hadoop 2 compilation in trunk

          • Major - Major loss of function.
          • Closed

          Activity

            People

              sseth Siddharth Seth
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: