Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-641

Lineage for a view created from a view seems to be confusing(from user's perspective).

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8.1, 0.8.2, 1.0.0
    • 0.8.3, 1.1.0, 2.0.0
    • None
    • None

    Description

      Lineage for a table created from the view seems to be confusing(from user's perspective).

      Steps to reproduce:

      0: jdbc:hive2://localhost:10000/default>
      0: jdbc:hive2://localhost:10000/default> create table src (x int, y int, s string);
      No rows affected (0.384 seconds)
      0: jdbc:hive2://localhost:10000/default> create view view1 as select * from src;
      No rows affected (0.225 seconds)
      0: jdbc:hive2://localhost:10000/default> create table view_table as select * from view1;
      INFO  : Number of reduce tasks is set to 0 since there's no reduce operator
      INFO  : number of splits:1
      INFO  : Submitting tokens for job: job_local1883260823_0021
      INFO  : The url to track the job: http://localhost:8080/
      INFO  : Job running in-process (local Hadoop)
      INFO  : 2016-04-06 18:15:02,538 Stage-1 map = 100%,  reduce = 0%
      INFO  : Ended Job = job_local1883260823_0021
      INFO  : Stage-4 is selected by condition resolver.
      INFO  : Stage-3 is filtered out by condition resolver.
      INFO  : Stage-5 is filtered out by condition resolver.
      INFO  : Moving data to: hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10001 from hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10003
      INFO  : Moving data to: hdfs://localhost:9000/user/hive/warehouse/view_table from hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10001
      INFO  : Table default.view_table stats: [numFiles=1, numRows=0, totalSize=0, rawDataSize=0]
      No rows affected (3.8 seconds)
      0: jdbc:hive2://localhost:10000/default> alter view view1 as select * from t2;
      No rows affected (0.602 seconds)
      0: jdbc:hive2://localhost:10000/default>
      

      Check the lineage of the resultant table(view_table).

      Link showing confusing lineage: https://monosnap.com/file/qaYZcJRQnNX5BsyM12hkryv70RZK1I

      Attachments

        1. ATLAS-641.patch
          1 kB
          Madhan Neethiraj

        Issue Links

          Activity

            People

              madhan Madhan Neethiraj
              ayubpathan Ayub Pathan
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: