Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8548 Integrate with remote Spark context after HIVE-8528 [Spark Branch]
  3. HIVE-8836

Enable automatic tests with remote spark client [Spark Branch]

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • spark-branch
    • 1.1.0
    • Spark

    Description

      In real production environment, remote spark client should be used to submit spark job for Hive mostly, we should enable automatic test with remote spark client to make sure the Hive feature workable with it.

      Attachments

        1. HIVE-8836.14-spark.patch
          236 kB
          Xuefu Zhang
        2. HIVE-8836.14-spark.patch
          236 kB
          Brock Noland
        3. HIVE-8836.13-spark.patch
          205 kB
          Brock Noland
        4. additional-enable-spark-log.patch
          3 kB
          Chengxiang Li
        5. HIVE-8836.9-spark.patch
          148 kB
          Brock Noland
        6. HIVE-8836.8-spark.patch
          147 kB
          Brock Noland
        7. HIVE-8836.7-spark.patch
          91 kB
          Brock Noland

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HIVE-8833 Unify spark client API and implement remote spark client.[Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HIVE-8959 SparkSession is not closed until JVM exit.[Spark Branch]

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Sub-task - The sub-task of the issue HIVE-8795 Switch precommit test from local to local-cluster [Spark Branch]

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HIVE-7382 Create a MiniSparkCluster and set up a testing framework [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HIVE-8981 Not a directory error in mapjoin_hook.q [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HIVE-8991 Fix custom_input_output_format [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HIVE-8992 Fix bucket related test failure: parquet_join.q [Spark Branch]

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-8976 Make nine additional tests deterministic

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              lirui Rui Li
              chengxiang li Chengxiang Li
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: