Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-10060

Provide more informative stage description in Spark Web UI [Spark Branch]

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 1.2.0
    • None
    • spark-branch
    • None

    Description

      Currently, for HoS in Spark Web UI, it displays stage information like the following:

      Description:
      foreachAsync at RemoteHiveSparkClient.java:254
      org.apache.spark.api.java.JavaPairRDD.foreachAsync(JavaPairRDD.scala:45)
      org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:254)
      org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:366)

      It would be better to provide more useful information, like what is the part of the query that this stage is about. Looks like this is implemented in SparkSQL.

      Attachments

        Activity

          People

            Unassigned Unassigned
            csun Chao Sun
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: