Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8512

ATSv2 entities are not published to HBase from second attempt onwards

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0, 2.10.0, 3.2.0, 3.0.3
    • 3.2.0, 3.1.1
    • None
    • Reviewed

    Description

      It is observed that if 1st attempt master container is died and 2nd attempt master container is launched in a NM where old containers are running but not master container.

      Attempt NM1 NM2 Action
      attempt-1 master container i.e container-1-1 container-1-2 master container died
      attempt-2 NA container-1-2 and master container container-2-1 NA

      In the above scenario, NM doesn't identifies flowContext and will get log below

      2018-07-10 00:44:38,285 WARN  storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:write(170)) - Found null for one of: flowName=null appId=application_1531175172425_0001 userId=hbase clusterId=yarn-cluster . Not proceeding with writing to hbase
2018-07-10 00:44:38,560 WARN  storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:write(170)) - Found null for one of: flowName=null appId=application_1531175172425_0001 userId=hbase clusterId=yarn-cluster . Not proceeding with writing to hbase

      Attachments

        1. YARN-8512.01.patch
          5 kB
          Rohith Sharma K S
        2. YARN-8512.02.patch
          6 kB
          Rohith Sharma K S
        3. YARN-8512.03.patch
          18 kB
          Rohith Sharma K S

        Activity

          People

            rohithsharma Rohith Sharma K S
            yeshavora Yesha Vora
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: