Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Won't Fix
-
None
-
None
-
None
Description
The DAGScheduler class contains two huge functions that make it
very hard to understand what's going on in the code. These are:
1) The monolithic handleTaskCompletion
2) The cleanupStateForJobAndIndependentStages function
These can be simply modularized to eliminate some awkward type casting and improve code readability.
Attachments
Issue Links
- blocks
-
SPARK-5945 Spark should not retry a stage infinitely on a FetchFailedException
- Closed
- links to