Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-478

Streaming should deliver stderr to the user.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • 0.12.0
    • None
    • None

    Description

      Streaming should collect stderr output of -mapper and - reduces steps and put it into the place accessible by the user.
      E.g. it can go into
      /user/name/stderr/job-id/task-id.txt

      This is indpendent from MapReduce framework catching stderr of "normal" Java MapReduce jobs.
      A Java programmer has many ways to handle the problem on her own (at least until the framework matures and provides more help).
      Unlike her, a user of Streaming has no access to files.
      Therefore it is an immediate requirement for Streaming to provide its own support for delivering this critical data to the user.

      Attachments

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-489 Seperating user logs from system logs in map reduce

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-805 JobClient should print the Task's stdout and stderr to the clients console

          • Major - Major loss of function.
          • Closed

          Wish - General wishlist item. HADOOP-440 In streaming, error messages issued in stream mappers or reducers don't go anywhere

          • Major - Major loss of function.
          • Closed

          Activity

            People

              sanjay.dahiya Sanjay Dahiya
              arkady arkady borkovsky
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: