[YARN-3091] [Umbrella] Improve and fix locks of RM scheduler - ASF JIRA

XML

Word

Printable

JSON

In existing YARN RM scheduler, there're some issues of using locks. For example:

Many unnecessary synchronized locks, we have seen several cases recently that too frequent access of scheduler makes scheduler hang. Which could be addressed by using read/write lock. Components include scheduler, CS queues, apps
Some fields not properly locked (Like clusterResource)

We can address them together in this ticket.

(More details see comments below)

is duplicated by

YARN-5964 Lower the granularity of locks in FairScheduler

is related to

YARN-3139 Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

HADOOP-9213 Create a Jenkins job to run jcarder

1.	CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock	Open	Varun Saxena
2.	FairScheduler: Use lock for queuemanager instead of synchronized on FairScheduler	Open	Unassigned
3.	Improve locks of OrderingPolicy	Open	Naganarasimha G R
4.	Introduce AtomicResource in ResourceUsage to avoid read-write lock.	Open	Unassigned