Details
-
Story
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
3.0.0
-
None
Description
Design and implement YARN support for GPU-aware scheduling:
- User can request GPU resources at Spark application level.
- How the Spark executor discovers GPU's when run on YARN
- Integrate with YARN 3.2 GPU support.
Attachments
Issue Links
- blocks
-
SPARK-27760 Spark resources - user configs change .count to be .amount
- Resolved
- is blocked by
-
SPARK-27024 Executor interface for cluster managers to support GPU resources
- Resolved
-
SPARK-23710 Upgrade the built-in Hive to 2.3.5 for hadoop-3.2
- Resolved
- relates to
-
SPARK-27959 Change YARN resource configs to use .amount
- Resolved
- links to
There are no Sub-Tasks for this issue.