Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6626

Reuse ObjectMapper instance in MapReduce

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.7.1
    • 2.8.0, 3.0.0-alpha1
    • performance
    • None
    • Reviewed

    Description

      Now in MapReduce, there are some places creating a new ObjectMapper instance every time. In wiki of ObjectMapper, it suggested:

      Further: it is beneficial to use just one instance (or small number of instances) for data binding; many optimizations for reuse (of symbol tables, some buffers) depend on ObjectMapper instances being reused.

      http://webcache.googleusercontent.com/search?q=cache:kybMTIJC6F4J:wiki.fasterxml.com/JacksonFAQ+&cd=4&hl=ja&ct=clnk&gl=jp, it's similar to HDFS-9724.

      Attachments

        1. MAPREDUCE-6626.004.patch
          3 kB
          Yiqun Lin
        2. MAPREDUCE-6626.003.patch
          3 kB
          Yiqun Lin
        3. MAPREDUCE-6626.002.patch
          3 kB
          Yiqun Lin
        4. MAPREDUCE.001.patch
          3 kB
          Yiqun Lin

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-9768 Reuse objectMapper instance in HDFS to improve the performance

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4668 Reuse objectMapper instance in Yarn

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              linyiqun Yiqun Lin
              linyiqun Yiqun Lin
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: