Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Done
-
None
-
None
Description
This task aims to support spark codegen instructions (for all templates) over multiple RDD inputs if not all side inputs fit into the local and remote broadcast memory budgets. In detail, this might entail either (1) generating custom RDD operations and functions for various combinations of input RDDs, or (2) a generalization of the related spark instructions regarding the input RDD construction and a generic function signature.
Attachments
Issue Links
- depends upon
-
SYSTEMDS-1374 Simplify cplan construction algorithm
- Closed