Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1373

Write Coordination Services for Samza Standalone using Azure

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      The current coordination primitives for Samza Standalone have been implemented using Zookeeper. Zookeeper is tedious to deploy on Azure and increases customer dependency on infrastructure. Writing coordination primitives in Azure will help identify issues with the current job coordinator design, validate the functionalities Samza Standalone claims it provides, and provide a platform for our customers to host their applications in the cloud. It will also provide more incentive for non-users of Samza to switch to Samza, and enable relatively smooth onboarding for customers that run their apps on Azure.

      Attachments

        Issue Links

          incorporates

          New Feature - A new feature of the product, which has yet to be developed. SAMZA-1374 Implement Leader Election using Lease Blob in Azure

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SAMZA-1379 Create Azure Client

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SAMZA-1380 Create Utility Class for interacting with Azure Blob Storage

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SAMZA-1381 Create Utility Class for interacting with Azure Table Storage

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SAMZA-1377 Implement Azure Job Coordinator

          • Major - Major loss of function.
          • Patch Available

          Improvement - An improvement or enhancement to an existing feature or task. SAMZA-1402 Refactor Azure Scheduler Interface

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1549 Synchronization issue between heartbeat scheduler and job coordinator main thread during processor shutdown

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1523 Cleanup table entries before shutting down the processor

          • Major - Major loss of function.
          • Closed

          Activity

            People

              pawas2703@gmail.com Pawas Chhokra
              pawas2703@gmail.com Pawas Chhokra
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: