Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-8544 Snapshot feature Phase 2 : Further enhancements for Ozone Snapshots
  3. HDDS-8316

SnapDiff: Persistent collection optimization

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      To store the snapDiff and intermediate objects, we implemented persistent collections (List, Map, Set) backed by RocksDB. Currently we do individual RocksDb put for every add/put operation to the collection. Which results to lots of I/O. We can optimize it by using WriteBatch and do batch updates of like 1000 entries.

      Attachments

        Activity

          People

            hemantk Hemant Kumar
            hemantk Hemant Kumar
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: