Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-10149

Bad file descriptor in TestOmSnapshotFsoWithNativeLib.testSnapshotCompactionDag

    XMLWordPrintableJSON

Details

    Description

      TestOmSnapshotFsoWithNativeLib failed in a CI run where it was really using the native library:

      org.apache.hadoop.ozone.om.snapshot.TestOmSnapshotFsoWithNativeLib.testSnapshotCompactionDag -- Time elapsed: 2.844 s <<< ERROR!
java.io.IOException: RocksDatabase[/home/runner/work/ozone/ozone/hadoop-ozone/integration-test/target/test-dir/MiniOzoneClusterImpl-d6a9ee09-9b79-4e8b-9241-4df752521eb9/ozone-meta/om.db]: Failed to compactRange; status : IOError; message : While pread offset 0 len 176: /home/runner/work/ozone/ozone/hadoop-ozone/integration-test/target/test-dir/MiniOzoneClusterImpl-d6a9ee09-9b79-4e8b-9241-4df752521eb9/ozone-meta/om.db/000508.sst: Bad file descriptor
	at org.apache.hadoop.hdds.utils.HddsServerUtil.toIOException(HddsServerUtil.java:667)
	at org.apache.hadoop.hdds.utils.db.RocksDatabase.toIOException(RocksDatabase.java:98)
	at org.apache.hadoop.hdds.utils.db.RocksDatabase.compactRange(RocksDatabase.java:595)
	at org.apache.hadoop.hdds.utils.db.RocksDatabase.compactDB(RocksDatabase.java:551)
	at org.apache.hadoop.hdds.utils.db.RDBStore.compactDB(RDBStore.java:216)
	at org.apache.hadoop.ozone.om.snapshot.TestOmSnapshot.testSnapshotCompactionDag(TestOmSnapshot.java:2415)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at java.util.ArrayList.forEach(ArrayList.java:1259)
	at java.util.ArrayList.forEach(ArrayList.java:1259)
Caused by: org.rocksdb.RocksDBException: While pread offset 0 len 176: /home/runner/work/ozone/ozone/hadoop-ozone/integration-test/target/test-dir/MiniOzoneClusterImpl-d6a9ee09-9b79-4e8b-9241-4df752521eb9/ozone-meta/om.db/000508.sst: Bad file descriptor
	at org.rocksdb.RocksDB.compactRange(Native Method)
	at org.rocksdb.RocksDB.compactRange(RocksDB.java:3416)
	at org.apache.hadoop.hdds.utils.db.RocksDatabase.compactRange(RocksDatabase.java:592)
	... 6 more

      CC smeng, hemantk

      Attachments

        Issue Links

          Discovered while testing

          Bug - A problem which impairs or prevents the functions of the product. HDDS-10148 TestOmSnapshotFsoWithNativeLib should be tagged as native test

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HDDS-9433 [snapshot] OM shutsdown on RocksDB failure when performing distcp of snapshots

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDDS-9711 [snapshot] RuntimeException encountered when generating snapshotDiff report between 2 snapshots

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HDDS-10487 Intermittent crash in TestSnapshotDiffManager

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #6182

          Activity

            People

              swamirishi Swaminathan Balachandran
              adoroszlai Attila Doroszlai
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: