Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-405

Netty-based Java RPC server

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • java
    • None
    • Reviewed

    Description

      A nonblocking RPC server based on Netty should be more scalable than the current implementation.

      We should provide two mechanisms for interfacing the RPC server to the implementations:

      1) "Blocking" RPC implementations run inside a worker threadpool. Implementators would not know that they're working in a non-blocking context.
      2) "Event-driven" RPC implementations that receive requests and some kind of request context. They are responsible for eventually calling context.respond(response) or somesuch. This would allow more scalable interaction with downstream services.

      I propose we focus on (1) first.

      Attachments

        1. AVRO-405-for-review.patch
          10 kB
          Bo Shi
        2. netty-avro.zip
          18 kB
          James Todd
        3. ASF.LICENSE.NOT.GRANTED--AVRO-405.patch
          28 kB
          James Todd
        4. AVRO-405-coolwhy.patch
          23 kB
          harry wang
        5. AVRO-405-coolwhy-new.patch
          26 kB
          harry wang

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. GIRAPH-211 Add secure authentication to Netty IPC

          • Major - Major loss of function.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. AVRO-406 Support streaming RPC calls

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. AVRO-539 Allow asynchronous clients to specify a callback to be run when server processing completes

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. AVRO-585 add async RPC cllient

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-916 Rewrite DFSOutputStream to use a single thread with NIO

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ZOOKEEPER-733 use netty to handle client connections

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HBASE-2400 new connector for Avro RPC access to HBase cluster

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Umbrella - An overarching type made of sub-tasks HBASE-2182 rpc/ipc refactor; x-version compatibility, nio, async, enveloping, sane timeouts, etc.

          • Major - Major loss of function.
          • Closed

          Activity

            People

              coolwhy harry wang
              tlipcon Todd Lipcon
              Votes:
              1 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: