Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-8544

Snapshot feature Phase 2 : Further enhancements for Ozone Snapshots

    XMLWordPrintableJSON

Details

    Description

      This issue will be used to enhance Snapshot feature support post Ozone release 1.4.0

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. HDDS-6517 Snapshot support for Ozone

          • Major - Major loss of function.
          • Resolved
          1.
          		 Revisit RocksDB configs when creating OMMetadataManager for bootstrapping code Sub-task Patch Available Hemant Kumar
          2.
          		 Update ozone ranger plugin to handle snapshots Sub-task Patch Available George Jahad
          3.
          		 [Snapshot] Revisit exception handling Sub-task Patch Available Swaminathan Balachandran
          4.
          		 Snapshot Deleting service should wait for response from OM for PurgeRequest Sub-task Patch Available Swaminathan Balachandran
          5.
          		 Use SnapshotId in BackgroundServices Sub-task Open Aswin Shakil
          6.
          		 [snapshot] Support snapshot generation through 'ozone freon' Sub-task Reopened Unassigned
          7.
          		 SnapDiff: Persistent collection optimization Sub-task Open Hemant Kumar
          8.
          		 Optimize Snapdiff to not check for invalid object ids from rocksdb Sub-task Open Swaminathan Balachandran
          9.
          		 [Snapshot] Check namespace quota handling when cleaning up snapshot Sub-task Open Aswin Shakil
          10.
          		 Add validation for OZONE_OM_SNAPSHOT_DB_MAX_OPEN_FILES Sub-task Open Swaminathan Balachandran
          11.
          		 Optimize Snapdiff to compute diff from Delta SST Files in case of DAG based Diff Sub-task Open Swaminathan Balachandran
          12.
          		 SSTFiltering service can delete SST tables for all column families Sub-task Open Swaminathan Balachandran
          13.
          		 Refactor RocksDBCheckpointDiffer class Sub-task Open Hemant Kumar
          14.
          		 [Snapshot] Add more detailed stages for SnapDiff job progress tracking Sub-task Open Unassigned
          15.
          		 [Snapshot] Allow SnapDiff workers to have separate output log files Sub-task Open Hemant Kumar
          16.
          		 HA aware reads from Snapshots Sub-task Open Hemant Kumar
          17.
          		 Remove rocks-tools-native for reading tombstone entries Sub-task Open Swaminathan Balachandran
          18.
          		 Update snapshot chain restore test to incorporate snapshot delete Sub-task Open Dave Teng
          19.
          		 Users with the necessary bucket access, should be able to create snapshots Sub-task Open Christos Bisias
          20.
          		 HA aware snapshot key read Sub-task Open Hemant Kumar
          21.
          		 Missing snapshot entries list Snapshot under a bucket API Sub-task Open Swaminathan Balachandran
          22.
          		 [Snapshot] Integration test for SnapshotDeletingService during OM failover Sub-task Open Aswin Shakil
          23.
          		 [Snapshot] Refactor OmSnapshotManager constructor to reduce initialization done when snapshot feature is disabled Sub-task Open Unassigned
          24.
          		 [Snapshot] Implement new quota including space exclusively used in snapshots Sub-task Open Unassigned
          25.
          		 [Snapshot] Implement SnapshotChainIterator Sub-task Open Unassigned
          26.
          		 [Snapshot] Make SnapshotChainManager singleton Sub-task Open Unassigned
          27.
          		 [Snapshot] Implement List SnapshotDiff jobs pagination Sub-task Reopened Unassigned
          28.
          		 Move helper code out of hdds-rocks-native Sub-task Open Unassigned
          29.
          		 [Snapshot] Performance impact for key & directory deleting service Sub-task Open Unassigned
          30.
          		 [Snapshot] Improve visibility into background service SnapshotDeletingTask Sub-task Open Unassigned
          31.
          		 Enhance debug tool to create a visual graph of compaction log DAG Sub-task Open Unassigned
          32.
          		 [Snapshot] Optionally purge SnapshotCache on OM (ex)leader when it transitions to a follower Sub-task Open Unassigned
          33.
          		 Confirm snapshot data correctness after bootstrapping Sub-task Open Unassigned
          34.
          		 Add support for metrics showing usage per snapshot Sub-task Open Unassigned
          35.
          		 Use protobuf for SnapshotDiffJobCodec Sub-task Open Unassigned
          36.
          		 Exclusive Snapshot size calculation for snapshots buckets with object versioning enabled Sub-task Open Unassigned
          37.
          		 Add a configurable limit on number of open snapshots concurrently Sub-task Open Swaminathan Balachandran
          38.
          		 Tarball creation failing on leader OM node Sub-task Open Unassigned
          39.
          		 [snapshot] Error message is not thrown when trying to create '.snapshot' directory the 2nd time Sub-task Open Unassigned
          40.
          		 Prevent snapshot creation beyond ozone.om.fs.snapshot.max.limit Sub-task Open Swaminathan Balachandran
          41.
          		 Keys should not be purged from file table while processing deleted directories in snapshot & should be purged from AOS instead Sub-task Open Swaminathan Balachandran
          42.
          		 OmSnapshotPurgeRequest is not atomic and can lead to SnapshotChain Corruption Sub-task Reopened Swaminathan Balachandran

          Activity

            People

              ppogde Prashant Pogde
              ppogde Prashant Pogde
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: