Uploaded image for project: 'Aurora'
  1. Aurora
  2. AURORA-1228

Use explicit status update acknowledgements to improve driver throughput.

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.9.0
    • Scheduler
    • None
    • Twitter Aurora Q2'15 Sprint 3

    Description

      Mesos 0.22.0 is released and includes the ability for schedulers to perform explicit acknowledgments of status updates.

      This allows schedulers to process status updates asynchronously from the driver thread. Updates can then be processed in batches to reduce the per-update processing overhead. These should help provide substantial improvements to the schedulers update processing throughput.

      I've placed this under the GC executor retirement effort, per AURORA-1047.

      Attachments

        Issue Links

          blocks

          Task - A task that needs to be done. AURORA-1047 Implement state reconciliation within the scheduler

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Task - A task that needs to be done. AURORA-1276 Upgrade to mesos 0.22

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. AURORA-1283 Implement a benchmark for status update processing throughput.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              bmahler Benjamin Mahler
              bmahler Benjamin Mahler
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: