Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
None
-
None
-
None
-
None
-
Reviewed
Description
Example provided for TEZ_TASK_SCALE_MEMORY_WEIGHTED_RATIOS in TezConfiguration is missing "UNSORTED_OUTPUT".
>>>
PARTITIONED_UNSORTED_OUTPUT:0,UNSORTED_INPUT:1,SORTED_OUTPUT:2,SORTED_MERGED_INPUT:3,PROCESSOR:1,OTHER:1
>>>
If user tries to set the value by referring to this, it would end up throwing exceptions in org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor.populateTypeScaleMap()