Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17740

Spark tests should mock / interpose HDFS to ensure that streams are closed

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.1.0
    • Spark Core
    • None

    Description

      As a followup to SPARK-17666, we should add a test to ensure filesystem connections are not leaked at least in unit tests.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-17666 take() or isEmpty() on dataset leaks s3a connections

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Pull request #15306 [Github] Pull Request #15306 (ericl)

          Activity

            People

              ekhliang Eric Liang
              ekhliang Eric Liang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: