Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2048 Expedite Partition Pruning
  3. HIVE-2118

Partition Pruning bug in the case of hive.mapred.mode=nonstrict

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.0
    • 0.8.0
    • None
    • None
    • Reviewed

    Description

      When hive.mapred.mode=nonstrict is set, Hive queries doesn't need to have a predicate on partition column. This means the partition expression in the PartitionPruner could be null or it could be null after removing predicates on non-partition columns. We need to handle those cases correctly in terms of whether the resulting partition should be inserted into the "true_parts" or "unknown_parts". The differences is in that if it is true_parts then "select *" queries will be translated to a non_MR job (a fetch task), otherwise it will be translated to a MR job.

      Attachments

        1. HIVE-2118.patch
          70 kB
          Ning Zhang

        Activity

          People

            nzhang Ning Zhang
            nzhang Ning Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: