Details
-
Sub-task
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
2.0.0
-
None
Description
The current code to create new stages is very confusing: it's difficult to reason about which functions actually create new stages versus just looking up existing stages, and there are many similarly-named functions that do very different things. The goal of this JIRA is to clean some of that up.
Attachments
Issue Links
- is duplicated by
-
SPARK-15422 Remove unnecessary calculation of stage's parents
- Resolved
- links to