Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8699 Enable support for common map join [Spark Branch]
  3. HIVE-8970

Enable map join optimization only when hive.auto.convert.join is true [Spark Branch]

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • spark-branch
    • 1.1.0
    • Spark
    • None

    Description

      Right now, in Spark branch we enable MJ without looking at this configuration. The related code in SparkMapJoinOptimizer is commented out. We should only enable MJ when the flag is true.

      Attachments

        1. HIVE-8970.1-spark.patch
          2.95 MB
          Chao Sun
        2. HIVE-8970.2-spark.patch
          2.95 MB
          Chao Sun
        3. HIVE-8970.3-spark.patch
          3.03 MB
          Chao Sun

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HIVE-9007 Hive may generate wrong plan for map join queries due to IdentityProjectRemover [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-8536 Enable SkewJoinResolver for spark [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              csun Chao Sun
              csun Chao Sun
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: