Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
We have encountered this problem on pig jobs loading two different datasets using different loaders.
The problem is the input location was not getting set correctly in getStatistics in ParquetLoader which was causing the path for the other loader to be used.
To fix we need a setInput call in getStatistics in:https://github.com/Parquet/parquet-mr/blob/master/parquet-pig/src/main/java/parquet/pig/ParquetLoader.java#L287