Details
Description
Lineage for a table created from the view seems to be confusing(from user's perspective).
Steps to reproduce:
0: jdbc:hive2://localhost:10000/default> 0: jdbc:hive2://localhost:10000/default> create table src (x int, y int, s string); No rows affected (0.384 seconds) 0: jdbc:hive2://localhost:10000/default> create view view1 as select * from src; No rows affected (0.225 seconds) 0: jdbc:hive2://localhost:10000/default> create table view_table as select * from view1; INFO : Number of reduce tasks is set to 0 since there's no reduce operator INFO : number of splits:1 INFO : Submitting tokens for job: job_local1883260823_0021 INFO : The url to track the job: http://localhost:8080/ INFO : Job running in-process (local Hadoop) INFO : 2016-04-06 18:15:02,538 Stage-1 map = 100%, reduce = 0% INFO : Ended Job = job_local1883260823_0021 INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Moving data to: hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10001 from hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10003 INFO : Moving data to: hdfs://localhost:9000/user/hive/warehouse/view_table from hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10001 INFO : Table default.view_table stats: [numFiles=1, numRows=0, totalSize=0, rawDataSize=0] No rows affected (3.8 seconds) 0: jdbc:hive2://localhost:10000/default> alter view view1 as select * from t2; No rows affected (0.602 seconds) 0: jdbc:hive2://localhost:10000/default>
Check the lineage of the resultant table(view_table).
Link showing confusing lineage: https://monosnap.com/file/qaYZcJRQnNX5BsyM12hkryv70RZK1I
Attachments
Attachments
Issue Links
- is related to
-
ATLAS-492 Hive Hook Improvements
- Resolved
- links to