Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-9418

Fix dtests on 2.2 branch on Windows

    XMLWordPrintableJSON

Details

    • Normal
    • Docs

    Description

      There's a variety of infrastructural failures within dtest w/regards to windows that are causing tests to fail and those failures to cascade.

      Error: failure to delete commit log after a test / ccm cluster is stopped:

      Traceback (most recent call last):
        File "C:\src\cassandra-dtest\dtest.py", line 452, in tearDown
          self._cleanup_cluster()
        File "C:\src\cassandra-dtest\dtest.py", line 172, in _cleanup_cluster
          self.cluster.remove()
        File "build\bdist.win-amd64\egg\ccmlib\cluster.py", line 212, in remove
          shutil.rmtree(self.get_path())
        File "C:\Python27\lib\shutil.py", line 247, in rmtree
          rmtree(fullname, ignore_errors, onerror)
        File "C:\Python27\lib\shutil.py", line 247, in rmtree
          rmtree(fullname, ignore_errors, onerror)
        File "C:\Python27\lib\shutil.py", line 252, in rmtree
          onerror(os.remove, fullname, sys.exc_info())
        File "C:\Python27\lib\shutil.py", line 250, in rmtree
          os.remove(fullname)
      WindowsError: [Error 5] Access is denied: 'c:\\temp\\dtest-4rxq2i\\test\\node1\\commitlogs\\CommitLog-5-1431969131917.log'
      

      Cascading error: implication is that tests aren't shutting down correctly and subsequent tests cannot start:

      06:00:20 ERROR: test_incr_decr_super_remove (thrift_tests.TestMutations)
      06:00:20 ----------------------------------------------------------------------
      06:00:20 Traceback (most recent call last):
      06:00:20   File "D:\jenkins\workspace\trunk_dtest_win32\cassandra-dtest\thrift_tests.py", line 55, in setUp
      06:00:20     cluster.start()
      06:00:20   File "build\bdist.win-amd64\egg\ccmlib\cluster.py", line 249, in start
      06:00:20     p = node.start(update_pid=False, jvm_args=jvm_args, profile_options=profile_options)
      06:00:20   File "build\bdist.win-amd64\egg\ccmlib\node.py", line 457, in start
      06:00:20     common.check_socket_available(itf)
      06:00:20   File "build\bdist.win-amd64\egg\ccmlib\common.py", line 341, in check_socket_available
      06:00:20     raise UnavailableSocketError("Inet address %s:%s is not available: %s" % (addr, port, msg))
      06:00:20 UnavailableSocketError: Inet address 127.0.0.1:9042 is not available: [Errno 10013] An attempt was made to access a socket in a way forbidden by its access permissions
      06:00:20 -------------------- >> begin captured logging << --------------------
      06:00:20 dtest: DEBUG: removing ccm cluster test at: d:\temp\dtest-a5iny5
      06:00:20 dtest: DEBUG: cluster ccm directory: d:\temp\dtest-dalzcy
      06:00:20 --------------------- >> end captured logging << ---------------------
      

      I've also seen (and am debugging) an error where a node just fails to start via ccm.

      I'll update this ticket with PR's to dtest or other observations of interest.

      Attachments

        1. 9418_tz_formatting.txt
          2 kB
          Joshua McKenzie

        Issue Links

          1.
          Fix cqlsh dtests on windows Sub-task Resolved T Jake Luciani
          2.
          Windows dtest: auth_test failure Sub-task Resolved Joshua McKenzie
          3.
          Windows dtest: fix commitlog_test errors Sub-task Resolved Joshua McKenzie
          4.
          Windows dtest: snapshot_test.py failures Sub-task Resolved Joshua McKenzie
          5.
          Windows dtest: invalid jolokia agent path Sub-task Resolved Paulo Motta
          6.
          Windows dtest: read timeout in consistency_test.py:TestConsistency.short_read_quorum_delete_test Sub-task Resolved T Jake Luciani
          7.
          Windows dtest: cqlsh_tests\cqlsh_copy_tests.py failing with Permission denied Sub-task Resolved Joshua McKenzie
          8.
          Windows dtest: offline_tools_test.py:TestOfflineTools.sstableverify_test Sub-task Resolved Paulo Motta
          9.
          sstablerepairedset has no .bat version Sub-task Resolved Paulo Motta
          10.
          Deprecated Repair tests fail on windows Sub-task Resolved Philip Thompson
          11.
          test_eat_glass in cqlsh_tests fails on windows Sub-task Resolved Paulo Motta
          12.
          Windows dtest: incremental_repair_test.py:TestIncRepair.multiple_subsequent_repair_test Sub-task Resolved Paulo Motta
          13.
          super_counter_test.py failing on Windows Sub-task Resolved Paulo Motta
          14.
          Read repair dtest failing on Windows Sub-task Resolved Paulo Motta
          15.
          Auth upgrade test failing on Windows 2.2 Sub-task Resolved Paulo Motta
          16.
          Windows dtest: json_tools_test.TestJson.json_tools_test Sub-task Resolved Paulo Motta
          17.
          Windows dtest: TestDistributedTTL.ttl_is_respected_on_delayed_replication_test Sub-task Resolved Unassigned
          18.
          Windows dtest 2.2: sstablesplit_test.py:TestSSTableSplit.split_test Sub-task Resolved Joshua McKenzie
          19.
          Windows dtest 2.2: thrift_hsha_test.py:ThriftHSHATest.test_6285 Sub-task Resolved Paulo Motta
          20.
          Windows dtest 2.2: json_test.py:JsonFullRowInsertSelect.pkey_requirement_test Sub-task Resolved Joshua McKenzie
          21.
          Windows dtest 2.2: rebuild_test.py:TestRebuild.simple_rebuild_test Sub-task Resolved Joshua McKenzie
          22.
          Windows dtest 2.2: paging_test.py:TestPagingWithDeletions.test_ttl_deletions flaky Sub-task Open Unassigned
          23.
          Windows dtest 2.2: commitlog_test.TestCommitLog.stop_failure_policy_test Sub-task Resolved Alan Boudreault
          24.
          Windows dtest: upgrade_tests submodule is failing Sub-task Resolved Philip Thompson

          Activity

            People

              Unassigned Unassigned
              JoshuaMcKenzie Joshua McKenzie
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: