Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-248

TailSource not closing files

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.9.1, 0.9.1u1
    • 0.9.2
    • Node, Sinks+Sources
    • None

    Description

      After logs rotated last night, the agent is still holding on to the log file it was tailing:

      java 14686 flume 41r REG 8,17 5989827 34996343 /var/log/httpd/logfile.log.1 (deleted)
      java 14686 flume 44r REG 8,17 5989827 34996343 /var/log/httpd/logfile.log.1 (deleted)

      The logs get rotated, then gzipped and the originals are deleted. It looks like the same issue may happen in other portions of the code; Bruce mentioned the RandomAccessFile objects in the reporter don't close files properly either.

      Agent configuration:
      agent1: tail( "/var/log/httpd/logfile.log", true ) | agentE2EChain( "collector1", "collector2", "collector3" );

      Attachments

        Issue Links

          Activity

            People

              jmhsieh Jonathan Hsieh
              flume_danieltm Disabled imported user
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: