Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-619

Queries should be normalized when tracking lineage at table

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.7-incubating
    • 0.7-incubating
    • None
    • None

    Description

      Partition type and entities are no loner being created after ATLAS-599. Even prior to this change , the linage for partition based queries are being tracked at the table level and not at the partition level which would be ideal. To track at the table level, the queries should be canonicialized for the partition values or only the latest few partition queries should be tracked since otherwise there could be potentially thousands of such queries while tracking lineage.

      Attachments

        1. ATLAS-619.4.patch
          71 kB
          Suma Shivaprasad
        2. ATLAS-619.patch
          25 kB
          Suma Shivaprasad

        Issue Links

          Activity

            People

              suma.shivaprasad Suma Shivaprasad
              suma.shivaprasad Suma Shivaprasad
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: