Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27063

Spark on K8S Integration Tests timeouts are too short for some test clusters

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 2.4.0
    • None
    • Kubernetes, Spark Core
    • None

    Description

      As noted during development for SPARK-26729 there are a couple of integration test timeouts that are too short when running on slower clusters e.g. developers laptops, small CI clusters etc

      skonto confirmed that he has also experienced this behaviour in the discussion on PR PR 23846

      We should up the defaults of this timeouts as an initial step and longer term consider making the timeouts themselves configurable

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rvesse Rob Vesse
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: