Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-13569

disable archiving + walCompactionEnabled probably broke reading from wal on server restart

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.10, 2.9.1
    • persistence

    Description

      • Start cluster with 4 server node
      • Preload
      • Start 4 clients
      • Start transactional loading
      • Wait 10 sec
        While loading:
        For node in server nodes:
        Kill -9 node
        Wait 20 sec
        Return node back
        Wait 20 sec

      Looks like node can't read all wal files that was generated before start node back

      [12:50:27,001][SEVERE][wal-file-compressor-%null%-1-#71][FileWriteAheadLogManager] Compression of WAL segment [idx=0] was skipped due to unexpected error
      class org.apache.ignite.IgniteCheckedException: WAL archive segment is missing: /storage/ssd/aromantsov/tiden/snapshots-190514-121520/test_pitr/node_1_1/0000000000000000.wal
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body0(FileWriteAheadLogManager.java:2076)
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body(FileWriteAheadLogManager.java:2054)
              at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
              at java.lang.Thread.run(Thread.java:748)
      [12:50:27,001][SEVERE][wal-file-compressor-%null%-0-#69][FileWriteAheadLogManager] Compression of WAL segment [idx=2] was skipped due to unexpected error
      class org.apache.ignite.IgniteCheckedException: WAL archive segment is missing: /storage/ssd/aromantsov/tiden/snapshots-190514-121520/test_pitr/node_1_1/0000000000000002.wal
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body0(FileWriteAheadLogManager.java:2076)
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.access$4800(FileWriteAheadLogManager.java:2019)
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressor.body(FileWriteAheadLogManager.java:1995)
              at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
              at java.lang.Thread.run(Thread.java:748)
      [12:50:27,001][SEVERE][wal-file-compressor-%null%-3-#73][FileWriteAheadLogManager] Compression of WAL segment [idx=3] was skipped due to unexpected error
      class org.apache.ignite.IgniteCheckedException: WAL archive segment is missing: /storage/ssd/aromantsov/tiden/snapshots-190514-121520/test_pitr/node_1_1/0000000000000003.wal
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body0(FileWriteAheadLogManager.java:2076)
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body(FileWriteAheadLogManager.java:2054)
              at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
              at java.lang.Thread.run(Thread.java:748)
      [12:50:27,001][SEVERE][wal-file-compressor-%null%-2-#72][FileWriteAheadLogManager] Compression of WAL segment [idx=1] was skipped due to unexpected error
      class org.apache.ignite.IgniteCheckedException: WAL archive segment is missing: /storage/ssd/aromantsov/tiden/snapshots-190514-121520/test_pitr/node_1_1/0000000000000001.wal
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body0(FileWriteAheadLogManager.java:2076)
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body(FileWriteAheadLogManager.java:2054)
              at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
              at java.lang.Thread.run(Thread.java:748)
      [12:50:27,002][SEVERE][wal-file-compressor-%null%-1-#71][FileWriteAheadLogManager] Compression of WAL segment [idx=4] was skipped due to unexpected error
      class org.apache.ignite.IgniteCheckedException: WAL archive segment is missing: /storage/ssd/aromantsov/tiden/snapshots-190514-121520/test_pitr/node_1_1/0000000000000004.wal
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body0(FileWriteAheadLogManager.java:2076)
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body(FileWriteAheadLogManager.java:2054)
              at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
              at java.lang.Thread.run(Thread.java:748)
      [12:50:27,002][SEVERE][wal-file-compressor-%null%-0-#69][FileWriteAheadLogManager] Compression of WAL segment [idx=5] was skipped due to unexpected error
      class org.apache.ignite.IgniteCheckedException: WAL archive segment is missing: /storage/ssd/aromantsov/tiden/snapshots-190514-121520/test_pitr/node_1_1/0000000000000005.wal
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body0(FileWriteAheadLogManager.java:2076)
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.access$4800(FileWriteAheadLogManager.java:2019)
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressor.body(FileWriteAheadLogManager.java:1995)
              at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
              at java.lang.Thread.run(Thread.java:748)
      [12:50:27,002][SEVERE][wal-file-compressor-%null%-3-#73][FileWriteAheadLogManager] Compression of WAL segment [idx=6] was skipped due to unexpected error
      class org.apache.ignite.IgniteCheckedException: WAL archive segment is missing: /storage/ssd/aromantsov/tiden/snapshots-190514-121520/test_pitr/node_1_1/0000000000000006.wal
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body0(FileWriteAheadLogManager.java:2076)
              at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileCompressorWorker.body(FileWriteAheadLogManager.java:2054)
              at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
              at java.lang.Thread.run(Thread.java:748)
      

      Attachments

        Issue Links

          Activity

            People

              akalashnikov Anton Kalashnikov
              akalashnikov Anton Kalashnikov
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h