Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28953

Integration tests fail due to malformed URL

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 3.0.0
    • None
    • jenkins, Kubernetes, Spark Core
    • None

    Description

      Tests failed on Ubuntu, verified on two different machines:

      KubernetesSuite:

      • Launcher client dependencies *** FAILED ***
        java.net.MalformedURLException: no protocol: * http://172.31.46.91:30706
        at java.net.URL.<init>(URL.java:600)
        at java.net.URL.<init>(URL.java:497)
        at java.net.URL.<init>(URL.java:446)
        at org.apache.spark.deploy.k8s.integrationtest.DepsTestsSuite.$anonfun$$init$$1(DepsTestsSuite.scala:160)
        at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
        at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
        at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
        at org.scalatest.Transformer.apply(Transformer.scala:22)
        at org.scalatest.Transformer.apply(Transformer.scala:20)
        at org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:186)

       

      Welcome to
      ____ __
      / _/_ ___ ____/ /_
      \ \/ _ \/ _ `/ __/ '/
      /__/ ./_,// //_\ version 3.0.0-SNAPSHOT
      /_/

      Using Scala version 2.12.8 (OpenJDK 64-Bit Server VM, Java 1.8.0_222)
      Type in expressions to have them evaluated.
      Type :help for more information.

       

      scala> val pb = new ProcessBuilder().command("bash", "-c", "minikube service ceph-nano-s3 -n spark --url")
      pb: ProcessBuilder = java.lang.ProcessBuilder@46092840

      scala> pb.redirectErrorStream(true)
      res0: ProcessBuilder = java.lang.ProcessBuilder@46092840

      scala> val proc = pb.start()
      proc: Process = java.lang.UNIXProcess@5e9650d3

      scala> val r = org.apache.commons.io.IOUtils.toString(proc.getInputStream())
      r: String =
      "* http://172.31.46.91:30706
      "

      Although (no asterisk):
      $ minikube service ceph-nano-s3 -n spark --url
      http://172.31.46.91:30706

       

      This is weird because it fails at the java level, where does the asterisk come from?

      $ minikube version
      minikube version: v1.3.1
      commit: ca60a424ce69a4d79f502650199ca2b52f29e631

       

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              skonto Stavros Kontopoulos
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: