Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-135

Input location is not getting set for the getStatistics in ParquetLoader when using two different loaders within a Pig script.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.6.0
    • None
    • None

    Description

      We have encountered this problem on pig jobs loading two different datasets using different loaders.

      The problem is the input location was not getting set correctly in getStatistics in ParquetLoader which was causing the path for the other loader to be used.

      To fix we need a setInput call in getStatistics in:https://github.com/Parquet/parquet-mr/blob/master/parquet-pig/src/main/java/parquet/pig/ParquetLoader.java#L287

      Attachments

        Activity

          People

            elif elif dede
            elif elif dede
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: