Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-44704

Cleanup shuffle files from host node after migration due to graceful decommissioning

    XMLWordPrintableJSON

Details

    Description

      Although these files will be deleted at the end of the application by the external shuffle service, doing this early can free up resources and can help in long running applications running out of disk space.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              deependra Deependra Patel
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: