Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11943

[Erasure coding] Warn log frequently print to screen in doEncode/doDecode functions

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha4
    • 3.0.0-alpha4
    • erasure-coding, native
    • None

    • cluster: 3 nodes
      os:(Red Hat 2.6.33.20, Red Hat 3.10.0-514.6.1.el7.x86_64, Ubuntu4.4.0-31-generic)
      hadoop version: hadoop-3.0.0-alpha4
      erasure coding: XOR-2-1-64k and enabled Intel ISA-L
      hadoop fs -put file /

    • Reviewed
    • Patch

    Description

      when i write file to hdfs on above environment, the hdfs client frequently print warn log of use direct ByteBuffer inputs/outputs in doEncode function to screen, detail information as follows:
      2017-06-07 15:20:42,856 WARN rawcoder.AbstractNativeRawEncoder: convertToByteBufferState is invoked, not efficiently. Please use direct ByteBuffer inputs/outputs

      Attachments

        1. HDFS-11943.patch
          1 kB
          liaoyuxiangqin
        2. HDFS-11943.002.patch
          1 kB
          liaoyuxiangqin
        3. HDFS-11943.003.patch
          2 kB
          liaoyuxiangqin
        4. HDFS-11943.004.patch
          3 kB
          liaoyuxiangqin
        5. HDFS-11943.005.patch
          3 kB
          liaoyuxiangqin

        Activity

          People

            liaoyuxiangqin liaoyuxiangqin
            liaoyuxiangqin liaoyuxiangqin
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 0.05h
                0.05h
                Remaining:
                Remaining Estimate - 0.05h
                0.05h
                Logged:
                Time Spent - Not Specified
                Not Specified