Uploaded image for project: 'Apache IoTDB'
  1. Apache IoTDB
  2. IOTDB-1903

The file disk space usage increases abnormally after IoTDB restarts

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.12.2
    • 0.12.3
    • None
    • 2021-10-DragonGate

    Description

      1. Description
        If the IoTDB is shut down when cross compaction when IoTDB is restarted, there will be abnormal redundant data in TsFile, but the abnormal data cannot be seen from the client.
      2. Cause
        1. The target file of cross-space compaction is deleted when sgp recover, the cross-space compaction recover can never find the target file.
        2. The MergeLogAnalyzer searches for a log that is never written to the log file.
        3. The resume cross-space compaction process gets the schema from merge resources, but the schema list in merge resources is always empty when performing recovery.
        4. The recovery of cross-space compaction uses an InputStream to truncate the file, which is forbidden by JVM.
        5. The ChunkMetadata list in the last chunk group is lost when using a RestorableTsFileIOWriter to continue to write on the target file.

       

       

      Attachments

        Issue Links

          Activity

            People

              ThuLiuxuxin Liuxuxin
              ThuLiuxuxin Liuxuxin
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified