Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.1.0
-
None
-
None
Description
If we have a very low minimum number of nodes, we may fill up the disks of executors by migrating shuffle files to them. We should add a configuration option to only accept remote shuffle blocks when there is sufficient free disk space.