Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-149 [Umbrella] ResourceManager (RM) Fail-over
  3. YARN-1559

Race between ServerRMProxy and ClientRMProxy setting RMProxy#INSTANCE

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 2.3.0
    • 2.3.0
    • resourcemanager
    • None
    • Reviewed

    Description

      RMProxy#INSTANCE is a non-final static field and both ServerRMProxy and ClientRMProxy set it. This leads to races as witnessed on - YARN-1482.

      Sample trace:

      java.lang.IllegalArgumentException: RM does not support this client protocol
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
        at org.apache.hadoop.yarn.client.ClientRMProxy.checkAllowedProtocols(ClientRMProxy.java:119)
        at org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider.init(ConfiguredRMFailoverProxyProvider.java:58)
        at org.apache.hadoop.yarn.client.RMProxy.createRMFailoverProxyProvider(RMProxy.java:158)
        at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:88)
        at org.apache.hadoop.yarn.server.api.ServerRMProxy.createRMProxy(ServerRMProxy.java:56)

      Attachments

        1. yarn-1559-3.patch
          6 kB
          Karthik Kambatla
        2. YARN-1559-20140105.txt
          9 kB
          Vinod Kumar Vavilapalli
        3. yarn-1559-2.patch
          10 kB
          Karthik Kambatla
        4. yarn-1559-1.patch
          10 kB
          Karthik Kambatla

        Issue Links

          blocks

          Sub-task - The sub-task of the issue YARN-1029 Allow embedding leader election into the RM

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue YARN-1482 WebApplicationProxy should be always-on w.r.t HA even if it is embedded in the RM

          • Major - Major loss of function.
          • Closed

          Activity

            People

              kasha Karthik Kambatla
              kasha Karthik Kambatla
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: