[HIVE-2048] Expedite Partition Pruning - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: Query Processor
Labels:
- JDO
- PartitionPruner

Description

Partition pruning is a large part of Hive client side overhead. Partition filter has been introduced by ~~HIVE-1609~~, but it is enabled due to JDO issues (~~HIVE-1853~~, ~~HIVE-1862~~). This JIRA is created as an umbrella to a set of optimizations we can do under this situation.

Attachments

Issue Links

is related to

HIVE-1862 Revive partition filtering in the Hive MetaStore

Closed

HIVE-1609 Support partition filtering in metastore

Closed

relates to

HIVE-2702 Enhance listPartitionsByFilter to add support for integral types both for equality and non-equality

Closed

Sub-Tasks

1.	Push down partition pruning to JDO filtering for a subset of partition predicates	Closed	Ning Zhang
2.	batch processing partition pruning process	Closed	Ning Zhang
3.	Add JDO filter to explain plan	Open	Unassigned
4.	Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()	Closed	Ning Zhang
5.	Partition Pruning bug in the case of hive.mapred.mode=nonstrict	Closed	Ning Zhang
6.	PartitionPruner should log why it is not pushing the filter down to JDO	Closed	Navis Ryu

Activity

People

Assignee:: Unassigned

Reporter:: Ning Zhang

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 11/Mar/11 20:12

Updated:: 16/Jul/13 01:19