Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-4881

Reduce logs printed during notification processing

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0
    • atlas-core
    • None

    Description

      While processing notifications from Hive hook, Atlas server can print several info level logs about its internal performance improvements, like the following:

      INFO  - [NotificationHookConsumer thread-0:] ~ setting hive_column_lineage.name=QUERY:db1.tbl1@cl1:1559003302000->:INSERT:db1.tbl1@cl1:1544966827000:col1. topic-offset=170, partition=0 (HivePreprocessor$HiveProcessPreprocessor:176)
INFO  - [NotificationHookConsumer thread-0:] ~ moved 269 referred-entities to end of entities-list (firstEntity:typeName=hive_table, qualifiedName=db1.tbl2@cl1). topic-offset=2143, partition=0 (PreprocessorContext:369)

      To avoid unnecessary overhead and the noise in the log file, these messages should be logged at debug level.

      Attachments

        1. ATLAS-4881.patch
          11 kB
          Madhan Neethiraj

        Activity

          People

            madhan Madhan Neethiraj
            madhan Madhan Neethiraj
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: