Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3490

Alleviate port collisions during tests

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.1.0
    • 0.9.3, 1.1.1, 1.2.0
    • Spark Core
    • None

    Description

      A few tests, notably SparkSubmitSuite and DriverSuite, have been failing intermittently because we open too many ephemeral ports and occasionally can't bind to new ones.

      We should minimize the use of ports during tests where possible. A great candidate is the SparkUI, which is not needed for most tests.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. SPARK-1047 Ability to disable the spark ui server (unit tests)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3431 Parallelize Scala/Java test execution

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #2363 [Github] Pull Request #2363 (andrewor14)

          Pull request #2415 [Github] Pull Request #2415 (andrewor14)

          Pull request #3959 [Github] Pull Request #3959 (andrewor14)

          Pull request #3961 [Github] Pull Request #3961 (andrewor14)

          Activity

            People

              andrewor14 Andrew Or
              andrewor14 Andrew Or
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: