Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3124

Add external metadata notification mechanisms to Impala

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • Impala 2.2.4
    • None
    • Catalog

    Description

      Currently, users needs to run refresh/invalidate metadata to update metadata when data (files, blocks) and/or metadata (tables, partitions) are modified externally. These operation cause many consistency and performance issues. We should add external metadata notification mechanism (e.g. inotify or HMS listeners) so that the catalog server can automatically sync metadata as they change.

      Attachments

        Issue Links

          There are no Sub-Tasks for this issue.

          Activity

            People

              Unassigned Unassigned
              dtsirogiannis Dimitris Tsirogiannis
              Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: