Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10548

Correct commons-math dependency version

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.96.2, 0.98.1, 0.99.0
    • 0.96.2, 0.98.1, 0.99.0, hbase-10070
    • test
    • None
    • Reviewed
    • Downgrades HBase's dependency on commons-math to 2.1, which is consistent with all stable releases of Hadoop.

    Description

      From my comment on HBASE-10511:

      I have hadoop-1.2.1 installed from tgz, which packages commons-math-2.1. This is different from the listed maven dependency, 2.2.

      $ tar tvf hadoop-1.2.1.tar.gz | grep commons-math
-rw-rw-r--  0 0      0      832410 Jul 22  2013 hadoop-1.2.1/lib/commons-math-2.1.jar
$ mvn -f pom.xml.hadoop1 dependency:tree | grep commons-math
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
[INFO] +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile

      This is a problem because the 2.1 version of DescriptiveStatistics doesn't have a double[] constructor. Running the MR job, mappers fail:

      java.lang.NoSuchMethodError: org.apache.commons.math.stat.descriptive.DescriptiveStatistics.<init>([D)V
	at org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest.testTakedown(PerformanceEvaluation.java:1163)
	at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:984)
	at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:1401)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:522)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:474)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)

      Attachments

        1. HBASE-10548.00.patch
          1 kB
          Nick Dimiduk
        2. HBASE-10548.01.patch
          2 kB
          Nick Dimiduk
        3. HBASE-10548.01-0.96.patch
          2 kB
          Nick Dimiduk
        4. HBASE-10548.01-0.98.patch
          2 kB
          Nick Dimiduk

        Issue Links

          is depended upon by

          Sub-task - The sub-task of the issue HBASE-10791 Add integration test to demonstrate performance improvement

          • Major - Major loss of function.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-10511 Add latency percentiles on PerformanceEvaluation

          • Major - Major loss of function.
          • Closed

          Activity

            People

              ndimiduk Nick Dimiduk
              ndimiduk Nick Dimiduk
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: