Details
-
Bug
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
0.96.2, 0.98.1, 0.99.0
-
None
-
Reviewed
-
Downgrades HBase's dependency on commons-math to 2.1, which is consistent with all stable releases of Hadoop.
Description
From my comment on HBASE-10511:
I have hadoop-1.2.1 installed from tgz, which packages commons-math-2.1. This is different from the listed maven dependency, 2.2.
$ tar tvf hadoop-1.2.1.tar.gz | grep commons-math -rw-rw-r-- 0 0 0 832410 Jul 22 2013 hadoop-1.2.1/lib/commons-math-2.1.jar $ mvn -f pom.xml.hadoop1 dependency:tree | grep commons-math [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1) [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1) [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1) [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1) [INFO] +- org.apache.commons:commons-math:jar:2.2:compile [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile [INFO] +- org.apache.commons:commons-math:jar:2.2:compile [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile [INFO] +- org.apache.commons:commons-math:jar:2.2:compile [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile
This is a problem because the 2.1 version of DescriptiveStatistics doesn't have a double[] constructor. Running the MR job, mappers fail:
java.lang.NoSuchMethodError: org.apache.commons.math.stat.descriptive.DescriptiveStatistics.<init>([D)V at org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest.testTakedown(PerformanceEvaluation.java:1163) at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:984) at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:1401) at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:522) at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:474) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
Attachments
Attachments
Issue Links
- is depended upon by
-
HBASE-10791 Add integration test to demonstrate performance improvement
-
- Closed
-
- relates to
-
HBASE-10511 Add latency percentiles on PerformanceEvaluation
-
- Closed
-