Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-25918

Ambari is not working with BIGTOP stack 3.2.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • 3.0.0
    • stacks
    • None

    Description

      I was trying to install hadoop cluster using ambari trunk, ambari metrics 3.0.0 and BIGTOP 3.2.0, stack-select from master code
      Installation is failing with following errors

      1. Stack installation failed with below error

      2023-03-31 07:21:11,018 - The 'hadoop-hdfs-datanode' component did not advertise a version. This may indicate a problem with the component packaging. However, the stack-select tool was able to report a single version installed (3.2.0). This is the version that will be reported.
      Traceback (most recent call last):
        File "/var/lib/ambari-agent/cache/stacks/BIGTOP/3.2.0/services/HDFS/package/scripts/datanode.py", line 172, in <module>
       ...
        raise Fail("No package found for {0}(expected name: {1})".format(name, name_with_version))
      resource_management.core.exceptions.Fail: No package found for hadoop_${stack_version}(expected name: hadoop_3_2_0)
      

      Seems this error is because BIGTOP packages are not versioned properly, packages are not prefixed with stack version. As a workaround I removed _${stack_version} from metafile.xml from all services for example removed _${stack_version} from stacks/BIGTOP/3.2.0/services/FLINK/metainfo.xml

      2. After removing _${stack_version} from services, packages got installed but it is still failing with below error

      2023-04-02 16:19:37,115 - The 'hadoop-hdfs-datanode' component did not advertise a version. This may indicate a problem with the component packaging. However, the stack-select tool was able to report a single version installed (3.2.0). This is the version that will be reported.
      Traceback (most recent call last):
        File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/hook.py", line 39, in <module>
      ...
      raise ExecutionFailed(err_msg, code, out, err)
      	resource_management.core.exceptions.ExecutionFailed: Execution of 'ambari-python-wrap /usr/lib/bigtop-select/distro-select set hadoop-hdfs-datanode 3.2.0' returned 1. ERROR: Invalid version 3.2.0
      	
      	Valid choices:
      	3.2.0
      

      Packages are installed in /usr/lib but bigtop-select is expecting these packages at /usr/bigtop/3.2.0. This is causing above problem.

      Attachments

        Issue Links

          Activity

            People

              arshad.mohammad Mohammad Arshad
              arshad.mohammad Mohammad Arshad
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: