Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
There are a number of log statements that occur every time new edits are tailed by a Standby NameNode. When edits are tailing only on the order of every tens of seconds, this is fine. With the work in HDFS-13150, however, edits may be tailed every few milliseconds, which can flood the logs with tailing-related statements. We should throttle it to limit it to printing at most, say, once per 5 seconds.
We can implement logic similar to that used in HDFS-10713. This may be slightly more tricky since the log statements are distributed across a few classes.
Attachments
Attachments
Issue Links
- causes
-
HDFS-16872 Fix log throttling by declaring LogThrottlingHelper as static members
- Resolved
- depends upon
-
HADOOP-15726 Create utility to limit frequency of log statements
- Resolved