Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4910

Build failed with Hadoop 1.x profile: "isFile is not a member of org.apache.hadoop.fs.FileStatus"

    XMLWordPrintableJSON

Details

    Description

      git clone
      mvn -DskipTests clean package

      ....
      [ERROR] /home/x/sources/spark_git/core/src/test/scala/org/apache/spark/scheduler/EventLoggingListenerSuite.scala:68: value isFile is not a member of org.apache.hadoop.fs.FileStatus
      [ERROR] assert(logStatus.isFile)
      [ERROR] ^
      [ERROR] /home/x/sources/spark_git/core/src/test/scala/org/apache/spark/scheduler/EventLoggingListenerSuite.scala:72: value isFile is not a member of org.apache.hadoop.fs.FileStatus
      [ERROR] assert(fileSystem.getFileStatus(new Path(eventLogger.logPath)).isFile())
      [ERROR] ^
      [ERROR] /home/x/sources/spark_git/core/src/test/scala/org/apache/spark/scheduler/ReplayListenerSuite.scala:115: value isFile is not a member of org.apache.hadoop.fs.FileStatus
      [ERROR] assert(eventLog.isFile)
      [ERROR] ^
      [ERROR] three errors found
      [DEBUG] Compilation failed (CompilerInterface)
      [INFO] ------------------------------------------------------------------------
      [INFO] Reactor Summary:
      [INFO]
      [INFO] Spark Project Parent POM ........................... SUCCESS [ 13.440 s]
      [INFO] Spark Project Networking ........................... SUCCESS [ 23.752 s]
      [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 18.842 s]
      [INFO] Spark Project Core ................................. FAILURE [06:34 min]
      [INFO] Spark Project Bagel ................................ SKIPPED
      [INFO] Spark Project GraphX ............................... SKIPPED
      [INFO] Spark Project Streaming ............................ SKIPPED
      [INFO] Spark Project Catalyst ............................. SKIPPED
      [INFO] Spark Project SQL .................................. SKIPPED
      [INFO] Spark Project ML Library ........................... SKIPPED
      [INFO] Spark Project Tools ................................ SKIPPED
      [INFO] Spark Project Hive ................................. SKIPPED

      even switch -DskipTests was provided it seems some tests are executed and failed

      Attachments

        Activity

          People

            srowen Sean R. Owen
            xhudik Tomas Hudik
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: