Description
Tez has it built-in. We can start with reusing it and then look at customization for better performance.
Attachments
Attachments
Issue Links
- is blocked by
-
TEZ-800 One-one edge with parallelism -1 fails if source vertex parallelism is not -1 as well
- Closed
-
TEZ-1143 1-1 source split event should be handled in Vertex.RUNNING and Vertex.INITED state
- Closed
-
TEZ-1145 Vertices should not start if they have uninitialized custom edges
- Closed
-
TEZ-1151 Vertex should stay in initializing state until custom vertex manager sets the parallelism
- Closed
-
TEZ-1164 Only events for tasks should be buffered in Initializing state
- Closed
-
TEZ-1171 Vertex remains in INITED state if all source vertices start while the vertex was in INITIALIZING state
- Closed
- is depended upon by
-
PIG-4015 Provide a way to disable auto-parallism in tez
- Closed
- relates to
-
TEZ-1170 Simplify Vertex Initializing transition
- Closed
Attach initial patch. Still need to add test cases and run through unit tests/e2e tests.