Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-3221

Support querying a table as of a savepoint

    XMLWordPrintableJSON

Details

    Description

      Right now point-in-time queries are limited to what's retained by the cleaner. If we fix this and expose via SQL, then it's a gap we close.

      Dataframe read path support this option but not for SQL read path

      https://hudi.apache.org/docs/quick-start-guide/#time-travel-query

      SparkSQL Syntax

      // code placeholder
SELECT * FROM A.B TIMESTAMP AS OF 1643119574;
SELECT * FROM A.B TIMESTAMP AS OF '2019-01-29 00:37:58';
SELECT * FROM A.B VERSION AS OF 'Snapshot123456789';

      Attachments

        Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. HUDI-109 RFC-7 Ability to query older snapshots of data

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          Testing discovered

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-3574 Improve maven module configs for different spark profiles

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #4720

          Web Link GitHub Pull Request #4885

          Web Link related GH issue

          Activity

            People

              x1q1j1 Forward Xu
              guoyihua Ethan Guo (this is the old account; please use "yihua")
              Shiyan Xu, Yann Byron
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: