Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-7593 Supporting HSync and lease recovery
  3. HDDS-9176

two client parallel perform commit with Hsync can cause dataloss

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Done
    • None
    • None
    • None
    • None

    Description

      2 client performs commit with hsync feature,

      • client 1 perform commit with Hsync with x block, key will be added in keyTable
      • client 2 perform commit with Hsync with y block,
        • will overwrite previous key,
        • quota can be issue as previous key of client 1 is used to identify space usages delta
      • client 1 perform final commit, will be treated as overwrite and remove blocks of client 2 data
      • client 2 perform final commit, this will overwrite and remove blocks of client 1 data

      So in above flow, it can cause dataloss and quota will be not be counted properly for space usages.

      Attachments

        Issue Links

          is fixed by

          Sub-task - The sub-task of the issue HDDS-10221 Make key visible immediately upon create()

          • Major - Major loss of function.
          • Open

          Sub-task - The sub-task of the issue HDDS-9930 Deleted file reappears after HSync

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDDS-9526 Two S3G instances writing the same key may cause data loss in case of an exception.

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              smeng Siyao Meng
              sumitagrawl Sumit Agrawal
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: