Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2113

Flume: No errors thrown but flume fails to transfer the file completely

    XMLWordPrintableJSON

Details

    • Question
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Flow: using a basic flow, spoolDir -> fileChannel -> HDFS

      No extra parameters set in the .conf file

      File size that i'm trying to transfer: 1.4GB

      Situation: the agents starts fine, the file transfer starts fine, the file in source gets renamed to .COMPLETED, the complete file is not getting transfered to HDFS, no errors/exceptions are being thrown. I ran the same adhoc several times i found that out of the 1.4 gigs only ~169Mb is getting transfered. Seems weird !

      Any suggestions? Any solutions? any hypotheses?

      Attachments

        Activity

          People

            Unassigned Unassigned
            kasavarun kasa v varun
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: