Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6581

Build with hadoop.profile=3.0

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None
    • None
    • Reviewed
    • Make us build against hadoop trunk (3.0)

    Description

      Building trunk with hadoop.profile=3.0 gives exceptions (see [1]) due to change in the hadoop maven modules naming (and also usage of 3.0-SNAPSHOT instead of 3.0.0-SNAPSHOT in hbase-common).

      I can provide a patch that would move most of hadoop dependencies in their respective profiles and will define the correct hadoop deps in the 3.0 profile.

      Please tell me if that's ok to go this way.

      Thx, Eric

      [1]
      $ mvn clean install -Dhadoop.profile=3.0
      [INFO] Scanning for projects...
      [ERROR] The build could not read 3 projects -> [Help 1]
      [ERROR]
      [ERROR] The project org.apache.hbase:hbase-server:0.95-SNAPSHOT (/d/hbase.svn/hbase-server/pom.xml) has 3 errors
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-common:jar is missing. @ line 655, column 21
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-annotations:jar is missing. @ line 659, column 21
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 663, column 21
      [ERROR]
      [ERROR] The project org.apache.hbase:hbase-common:0.95-SNAPSHOT (/d/hbase.svn/hbase-common/pom.xml) has 3 errors
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-common:jar is missing. @ line 170, column 21
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-annotations:jar is missing. @ line 174, column 21
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 178, column 21
      [ERROR]
      [ERROR] The project org.apache.hbase:hbase-it:0.95-SNAPSHOT (/d/hbase.svn/hbase-it/pom.xml) has 3 errors
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-common:jar is missing. @ line 220, column 18
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-annotations:jar is missing. @ line 224, column 21
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 228, column 21
      [ERROR]

      Attachments

        1. 6581-010.txt
          4 kB
          Ted Yu
        2. 6581-009.txt
          1 kB
          Ted Yu
        3. 6581v2.txt
          10 kB
          Michael Stack
        4. 6581.txt
          11 kB
          Michael Stack
        5. HBASE-6581-8-pom.patch
          29 kB
          Eric Charles
        6. HBASE-6581-7.patch
          41 kB
          Eric Charles
        7. HBASE-6581-6.patch
          40 kB
          Eric Charles
        8. HBASE-6581-5.patch
          34 kB
          Eric Charles
        9. HBASE-6581-4.patch
          31 kB
          Eric Charles
        10. HBASE-6581-3.patch
          30 kB
          Eric Charles
        11. HBASE-6581-20130821.patch
          6.44 MB
          Eric Charles
        12. HBASE-6581.diff
          25 kB
          Ivan Kelly
        13. HBASE-6581.diff
          18 kB
          Ivan Kelly
        14. HBASE-6581-2.patch
          15 kB
          Eric Charles
        15. HBASE-6581-1.patch
          9 kB
          Eric Charles

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-2973 Make sure Oozie works with Hadoop 3

          • Blocker - Blocks development and/or testing work, production could not run
          • Open
          is depended upon by

          Sub-task - The sub-task of the issue YARN-2032 Implement a scalable, available TimelineStore using HBase

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HBASE-17925 mvn assembly:single fails against hadoop3-alpha2

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-16711 Fix hadoop-3.0 profile compile

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-16712 fix hadoop-3.0 profile mvn install

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              eric@apache.org Eric Charles
              eric@apache.org Eric Charles
              Votes:
              2 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: