Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3168

reduce amount of logging in hadoop streaming

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.15.3, 0.16.0, 0.16.1, 0.16.2
    • 0.17.0
    • None
    • None
    • Reviewed
    • Decreases the frequency of logging from streaming from every 100 records to every 10,000 records.

    Description

      logs every 100 records:

      void maybeLogRecord() {
      if (numRecRead_ >= nextRecReadLog_)

      { String info = numRecInfo(); logprintln(info); logflush(); //nextRecReadLog_ *= 10; nextRecReadLog_ += 100; }

      }

      ouch.

      Attachments

        1. patch.txt
          0.6 kB
          Zheng Shao

        Activity

          People

            zshao Zheng Shao
            jsensarma Joydeep Sen Sarma
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: