Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2128

Generating the jar file takes a lot of time and is unnecessary when running Pig local mode

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.9.2, 0.10.0
    • impl
    • None
    • Patch Available
    • local mode will now skip building a jar with dependencies

    Description

      Since the Pig local mode implementation has been moved to Hadoop local it is very slow.
      We should optimize some of the steps so that it is more user friendly.
      In this case we should skip building the jar for each job as it runs in the same process.

      Attachments

        1. PIG-2128.patch
          1 kB
          Julien Le Dem

        Activity

          People

            julienledem Julien Le Dem
            julienledem Julien Le Dem
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: