[TEZ-2119] Counter for launched containers - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.10.3
Component/s: None
Labels:
None

Description

org.apache.tez.common.counters.DAGCounter
NUM_SUCCEEDED_TASKS=32976
TOTAL_LAUNCHED_TASKS=32976
OTHER_LOCAL_TASKS=2
DATA_LOCAL_TASKS=9147
RACK_LOCAL_TASKS=23761

It would be very nice to have TOTAL_LAUNCHED_CONTAINERS counter added to this. The difference between TOTAL_LAUNCHED_CONTAINERS and TOTAL_LAUNCHED_TASKS should make it easy to see how much container reuse is happening. It is very hard to find out now.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

TEZ-2119.01.patch
21/Feb/20 12:57
19 kB
László Bodor

Issue Links

is duplicated by

TEZ-329 Add metrics for reused containers

Resolved

relates to

TEZ-987 Need a way to measure container reuse

Open

YARN-6532 Allocated container metrics per application should be exposed using Yarn & ATS rest APIs

Open

links to

GitHub Pull Request #301

Activity

People

Assignee:: László Bodor

Reporter:: Rohini Palaniswamy

Votes:: 0 Vote for this issue

Watchers:: 12 Start watching this issue

Dates

Created:: 18/Feb/15 23:42

Updated:: 24/Aug/23 20:30

Resolved:: 24/Aug/23 20:30

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

3h 20m