Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6581

Build with hadoop.profile=3.0

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None
    • None
    • Reviewed
    • Make us build against hadoop trunk (3.0)

    Description

      Building trunk with hadoop.profile=3.0 gives exceptions (see [1]) due to change in the hadoop maven modules naming (and also usage of 3.0-SNAPSHOT instead of 3.0.0-SNAPSHOT in hbase-common).

      I can provide a patch that would move most of hadoop dependencies in their respective profiles and will define the correct hadoop deps in the 3.0 profile.

      Please tell me if that's ok to go this way.

      Thx, Eric

      [1]
      $ mvn clean install -Dhadoop.profile=3.0
      [INFO] Scanning for projects...
      [ERROR] The build could not read 3 projects -> [Help 1]
      [ERROR]
      [ERROR] The project org.apache.hbase:hbase-server:0.95-SNAPSHOT (/d/hbase.svn/hbase-server/pom.xml) has 3 errors
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-common:jar is missing. @ line 655, column 21
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-annotations:jar is missing. @ line 659, column 21
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 663, column 21
      [ERROR]
      [ERROR] The project org.apache.hbase:hbase-common:0.95-SNAPSHOT (/d/hbase.svn/hbase-common/pom.xml) has 3 errors
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-common:jar is missing. @ line 170, column 21
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-annotations:jar is missing. @ line 174, column 21
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 178, column 21
      [ERROR]
      [ERROR] The project org.apache.hbase:hbase-it:0.95-SNAPSHOT (/d/hbase.svn/hbase-it/pom.xml) has 3 errors
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-common:jar is missing. @ line 220, column 18
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-annotations:jar is missing. @ line 224, column 21
      [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 228, column 21
      [ERROR]

      Attachments

        1. HBASE-6581-1.patch
          9 kB
          Eric Charles
        2. HBASE-6581-2.patch
          15 kB
          Eric Charles
        3. HBASE-6581.diff
          18 kB
          Ivan Kelly
        4. HBASE-6581.diff
          25 kB
          Ivan Kelly
        5. HBASE-6581-20130821.patch
          6.44 MB
          Eric Charles
        6. HBASE-6581-3.patch
          30 kB
          Eric Charles
        7. HBASE-6581-4.patch
          31 kB
          Eric Charles
        8. HBASE-6581-5.patch
          34 kB
          Eric Charles
        9. HBASE-6581-6.patch
          40 kB
          Eric Charles
        10. HBASE-6581-7.patch
          41 kB
          Eric Charles
        11. HBASE-6581-8-pom.patch
          29 kB
          Eric Charles
        12. 6581.txt
          11 kB
          Michael Stack
        13. 6581v2.txt
          10 kB
          Michael Stack
        14. 6581-009.txt
          1 kB
          Ted Yu
        15. 6581-010.txt
          4 kB
          Ted Yu

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-2973 Make sure Oozie works with Hadoop 3

          • Blocker - Blocks development and/or testing work, production could not run
          • Open
          is depended upon by

          Sub-task - The sub-task of the issue YARN-2032 Implement a scalable, available TimelineStore using HBase

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HBASE-17925 mvn assembly:single fails against hadoop3-alpha2

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-16711 Fix hadoop-3.0 profile compile

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-16712 fix hadoop-3.0 profile mvn install

          • Major - Major loss of function.
          • Resolved
          There are no Sub-Tasks for this issue.

          Activity

            People

              eric@apache.org Eric Charles
              eric@apache.org Eric Charles
              Votes:
              2 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: