Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-8456

Support Hive Counter to collect spark job metric[Spark Branch]

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • Spark

    Description

      Several Hive query metric in Hive operators is collected by Hive Counter, such as CREATEDFILES and DESERIALIZE_ERRORS, Besides, Hive use Counter as an option to collect table stats info. Spark support Accumulator which is pretty similiar with Hive Counter, we could try to enable Hive Counter based on it.

      Attachments

        1. HIVE-8456.1-spark.patch
          10 kB
          Chengxiang Li
        2. HIVE-8456.2-spark.patch
          10 kB
          Chengxiang Li
        3. HIVE-8456.3-spark.patch
          10 kB
          Chengxiang Li

        Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. HIVE-7551 expand spark accumulator to support hive counter [Spark Branch]

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link https://reviews.apache.org/r/26733/

          Activity

            People

              chengxiang li Chengxiang Li
              chengxiang li Chengxiang Li
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: