Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-38305

Check existence of file before untarring/zipping

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 3.2.1
    • 3.3.0, 3.1.4, 3.2.2
    • Spark Core
    • None

    Description

      Some discussion related to Hadoop revealed that its FileUtil.unTar and unZip methods might have a problem if the source file does not actually exist.

      It's trivial to check for this in the one place we use it in Spark, and just explicitly error if the source file does not exist.

      Attachments

        Issue Links

          Activity

            People

              srowen Sean R. Owen
              srowen Sean R. Owen
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: