Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27178

k8s test failing due to missing nss library in dockerfile

    XMLWordPrintableJSON

Details

    Description

      while performing some tests on our existing minikube and k8s infrastructure, i noticed that the integration tests were failing. i dug in and discovered the following message buried at the end of the stacktrace:

        Caused by: java.io.FileNotFoundException: /usr/lib/libnss3.so
        	at sun.security.pkcs11.Secmod.initialize(Secmod.java:193)
        	at sun.security.pkcs11.SunPKCS11.<init>(SunPKCS11.java:218)
        	... 81 more
      

      after i added the 'nss' package to resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile, everything worked.

      i will also check and see if this is failing on 2.4...

      tbh, i have no idea why this literally started failing today and not earlier. the only recent change to this file that i can find is https://issues.apache.org/jira/browse/SPARK-26995

      Attachments

        Activity

          People

            shaneknapp Shane Knapp
            shaneknapp Shane Knapp
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: