Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-13704

Safer handling of out of range tokens

    XMLWordPrintableJSON

Details

    • Critical
    • 4.0
    • Hide

      There are several new unit and distributed tests around out-of-token-range requests, in addition to new bits of logging when these requests occur and metrics that count their frequencies.

      Show
      There are several new unit and distributed tests around out-of-token-range requests, in addition to new bits of logging when these requests occur and metrics that count their frequencies.

    Description

      It is possible for nodes to have a divergent view of the ring, which can result in some operations being sent to the wrong nodes. This is an umbrella ticket to mitigate such issues by adding logging when a node is asked to perform an operation for tokens it does not own. This will be useful for detecting when the nodes' views of the ring diverge, which is not highly visible at the moment, and also for post-hoc analysis.

      It may also be beneficial to straight up reject certain operations, though this will need to balance the risk of performing those ops against the consequences rejecting them has on availability.

      Attachments

        1. result_details.tar-2.gz
          2.56 MB
          Caleb Rackliffe
        2. result_details.tar-1.gz
          40.30 MB
          Caleb Rackliffe
        3. result_details.tar.gz
          28.78 MB
          Caleb Rackliffe
        4. ci_summary-2.html
          39 kB
          Caleb Rackliffe
        5. ci_summary-1.html
          88 kB
          Caleb Rackliffe
        6. ci_summary.html
          8 kB
          Caleb Rackliffe
        7. CASSANDRA-13704_5-0_25_results_details.tar.xz
          9.32 MB
          Michael Semb Wever
        8. CASSANDRA-13704_5-0_25_ci_summary.html
          31.75 MB
          Michael Semb Wever
        9. CASSANDRA-13704_5-0_24_results_details.tar.xz
          13.24 MB
          Michael Semb Wever
        10. CASSANDRA-13704_5-0_24_ci_summary.html
          49.02 MB
          Michael Semb Wever
        11. CASSANDRA-13704_5-0_23_results_details.tar.xz
          1.24 MB
          Michael Semb Wever
        12. CASSANDRA-13704_5-0_23_ci_summary.html
          1.01 MB
          Michael Semb Wever

        Issue Links

          incorporates

          Sub-task - The sub-task of the issue CASSANDRA-13705 Warn or error when receiving write requests for unowned token ranges

          • Normal -
          • Resolved

          Sub-task - The sub-task of the issue CASSANDRA-13706 Warn or error when receiving a read request for unowned token ranges

          • Normal -
          • Resolved

          Sub-task - The sub-task of the issue CASSANDRA-13707 Warn or error when receiving Merkle Tree requests for unowned token ranges

          • Normal -
          • Resolved

          Sub-task - The sub-task of the issue CASSANDRA-13708 Warn or error when receiving stream requests or inbound streams that contain unowned token ranges

          • Normal -
          • Resolved

          Sub-task - The sub-task of the issue CASSANDRA-13709 Warn or error when receiving hints for unowned token ranges

          • Normal -
          • Resolved

          Sub-task - The sub-task of the issue CASSANDRA-13710 Add a nodetool command to display details of any tables containing unowned tokens

          • Normal -
          • Resolved
          links to

          Web Link GitHub Pull Request #3526

          Web Link GitHub Pull Request #3539

          Web Link GitHub Pull Request #3544

          Activity

            People

              maedhroz Caleb Rackliffe
              samt Sam Tunnicliffe
              Ariel Weisberg, Caleb Rackliffe, Michael Semb Wever, Sam Tunnicliffe
              Michael Semb Wever
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 8h 10m
                  8h 10m