Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-2076

DataNode install failed with custom users

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.2.3
    • 1.2.3
    • None
    • None

    Description

      1) Using latest QA build
      2) Modified all log and pid directories (just added an 'xx' to all props)
      3) Modified all user accounts (just added an 'xx' to all props) – see screen shot
      4) Install failed error below on the datanode install
      stderr:
      none
      none
      stdout:
      notice: /Stagemain/Hdp-repos::Process_repo/FileHDP/ensure: defined content as '

      {md5}e4521dbc3c19e73cef603cd7d2a7f1b0'
      notice: Finished catalog run in 0.11 seconds
      notice: /Stagemain/Hdp-repos::Process_repo/FileHDP-epel/ensure: defined content as '{md5}

      e9b95c5b568ee24769f8d0f851acade2'
      notice: Finished catalog run in 0.05 seconds
      warning: Dynamic lookup of $ambari_db_rca_url is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
      warning: Dynamic lookup of $ambari_db_rca_driver is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
      warning: Dynamic lookup of $ambari_db_rca_username is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
      warning: Dynamic lookup of $ambari_db_rca_password is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
      notice: /Stage1/Hdp::Create_smoke_user/Groupusersxx/ensure: created
      notice: /Stage1/Hdp/Grouphadoopxx/ensure: created
      notice: /Stage1/Hdp::Create_smoke_user/Hdp::Userambari-qa/Userambari-qa/ensure: created
      notice: /Stage1/Hdp::Create_smoke_user/Hdp::Execusermod -u 1012 ambari-qa/Execusermod -u 1012 ambari-qa/returns: executed successfully
      notice: /Stage1/Hdp::Snappy::Package/Hdp::Packagesnappy/Hdp::Package::Process_pkgsnappy/Packagesnappy/ensure: created
      notice: /Stage1/Hdp::Snmp/Hdp::Packagesnmp/Hdp::Package::Process_pkgsnmp/Packagenet-snmp-utils/ensure: created
      notice: /Stage1/Hdp::Snmp/Hdp::Packagesnmp/Hdp::Package::Process_pkgsnmp/Packagenet-snmp/ensure: created
      notice: /Stage1/Hdp::Snmp/Hdp::Packagesnmp/Hdp::Package::Process_pkgsnmp/Hdp::Java::Packagesnmp/Execmkdir -p /tmp/HDP-artifacts/ ; curl -f --retry 10 http://ip-10-101-1-112.ec2.internal:8080/resources//jdk-6u31-linux-x64.bin -o /tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp/returns: executed successfully
      notice: /Stage1/Hdp::Set_selinux/Hdp::Exec/bin/echo 0 > /selinux/enforce/Exec/bin/echo 0 > /selinux/enforce/returns: executed successfully
      notice: /Stage1/Hdp::Snmp/Hdp::Packagesnmp/Hdp::Package::Process_pkgsnmp/Hdp::Java::Packagesnmp/Exec[mkdir -p /usr/jdk ; chmod +x /tmp/HDP-artifacts//jdk-6u31-linux-x64.bin; cd /usr/jdk ; echo A | /tmp/HDP-artifacts//jdk-6u31-linux-x64.bin -noregister > /dev/null 2>&1 snmp]/returns: executed successfully
      notice: /Stage1/Hdp::Snmp/Hdp::Packagesnmp/Hdp::Package::Process_pkgsnmp/Hdp::Java::Packagesnmp/File/usr/jdk/jdk1.6.0_31/bin/java snmp/ensure: created
      notice: /Stage1/Hdp::Snmp/Hdp::Snmp-configfilesnmpd.conf/Hdp::Configfile/etc/snmp//snmpd.conf/File/etc/snmp//snmpd.conf/content: content changed '

      {md5}8307434bc8ed4e2a7df4928fb4232778' to '{md5}

      f786955c0c36f7f5a4f375e3fe93c959'
      notice: /Stage1/Hdp::Snmp/Servicesnmpd/ensure: ensure changed 'stopped' to 'running'
      notice: /Stage1/Hdp::Snmp/Servicesnmpd: Triggered 'refresh' from 1 events
      notice: /Stage1/Hdp::Snappy::Package/Hdp::Packagesnappy/Hdp::Package::Process_pkgsnappy/Packagesnappy-devel/ensure: created
      notice: /Stage1/Hdp::Snappy::Package/Hdp::Snappy::Package::Ln64/Hdp::Exechdp::snappy::package::ln 64/Exechdp::snappy::package::ln 64/returns: executed successfully
      notice: /Stage1/Hdp::Snappy::Package/Hdp::Snappy::Package::Ln32/Hdp::Exechdp::snappy::package::ln 32/Exechdp::snappy::package::ln 32/returns: executed successfully
      notice: /Stage1/Hdp/Hdp::Packageglibc/Hdp::Package::Process_pkgglibc/Packageglibc.i686/ensure: created
      notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop 64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-sbin/ensure: created
      notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop 64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-libhdfs/ensure: created
      notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop 64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-pipes/ensure: created
      notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop 64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-native/ensure: created
      notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop 64/Hdp::Package::Process_pkghadoop 64/Hdp::Java::Packagehadoop 64/File/usr/jdk/jdk1.6.0_31/bin/java hadoop 64/ensure: created
      notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop 64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-lzo/ensure: created
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/var/run/hadoopXX/Hdp::Execmkdir -p /var/run/hadoopXX/Execmkdir -p /var/run/hadoopXX/returns: executed successfully
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/var/run/hadoopXX/Hdp::Directory/var/run/hadoopXX/File/var/run/hadoopXX/group: group changed 'root' to 'hadoopxx'
      notice: /Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/0/hadoop/hdfs/data/Hdp::Execmkdir -p /grid/0/hadoop/hdfs/data ; exit 0/Execmkdir -p /grid/0/hadoop/hdfs/data ; exit 0/returns: executed successfully
      notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop 64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-lzo-native/ensure: created
      notice: /Stage2/Hdp-hadoop::Initialize/Hdp::Packageambari-log4j/Hdp::Package::Process_pkgambari-log4j/Hdp::Java::Packageambari-log4j/File/usr/jdk/jdk1.6.0_31/bin/java ambari-log4j/ensure: created
      notice: /Stage2/Hdp-hadoop::Initialize/Hdp::Packageambari-log4j/Hdp::Package::Process_pkgambari-log4j/Packageambari-log4j/ensure: created
      notice: /Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/1/hadoop/hdfs/data/Hdp::Execmkdir -p /grid/1/hadoop/hdfs/data ; exit 0/Execmkdir -p /grid/1/hadoop/hdfs/data ; exit 0/returns: executed successfully
      err: /Stagemain/Hdp-hadoop/Hdp::Usermapredxx/Usermapredxx/ensure: change from absent to present failed: Could not create user mapredxx: Execution of '/usr/sbin/useradd -s /bin/bash -g hadoopxx -G hadoopxx,mapredxx -m mapredxx' returned 6: useradd: group 'mapredxx' does not exist
      notice: /Stage2/Hdp-hadoop::Initialize/File/usr/lib/hadoop/lib/hadoop-tools.jar/ensure: created
      notice: /Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/1/hadoop/hdfs/data/Hdp::Execchown hdfsxx:hadoopxx /grid/1/hadoop/hdfs/data; exit 0/Execchown hdfsxx:hadoopxx /grid/1/hadoop/hdfs/data; exit 0/returns: executed successfully
      notice: /Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/1/hadoop/hdfs/data/Hdp::Execchmod 0750 /grid/1/hadoop/hdfs/data ; exit 0/Execchmod 0750 /grid/1/hadoop/hdfs/data ; exit 0/returns: executed successfully
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/var/log/hadoopXX/Hdp::Execmkdir -p /var/log/hadoopXX/Execmkdir -p /var/log/hadoopXX/returns: executed successfully
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/var/log/hadoopXX/Hdp::Directory/var/log/hadoopXX/File/var/log/hadoopXX/group: group changed 'root' to 'hadoopxx'
      notice: /Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/0/hadoop/hdfs/data/Hdp::Execchown hdfsxx:hadoopxx /grid/0/hadoop/hdfs/data; exit 0/Execchown hdfsxx:hadoopxx /grid/0/hadoop/hdfs/data; exit 0/returns: executed successfully
      notice: /Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/0/hadoop/hdfs/data/Hdp::Execchmod 0750 /grid/0/hadoop/hdfs/data ; exit 0/Execchmod 0750 /grid/0/hadoop/hdfs/data ; exit 0/returns: executed successfully
      err: /Stagemain/Hdp-hadoop/Hdp::Userhdfsxx/Userhdfsxx/ensure: change from absent to present failed: Could not create user hdfsxx: Execution of '/usr/sbin/useradd -s /bin/bash -g hadoopxx -G hadoopxx,hdfsxx -m hdfsxx' returned 6: useradd: group 'hdfsxx' does not exist
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir -p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::begin: Dependency Usermapredxx has failures: true
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir -p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::begin: Dependency Userhdfsxx has failures: true
      warning: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir -p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::begin: Skipping because of failed dependencies
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir -p /etc/hadoop/conf/Execmkdir -p /etc/hadoop/conf: Dependency Usermapredxx has failures: true
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir -p /etc/hadoop/conf/Execmkdir -p /etc/hadoop/conf: Dependency Userhdfsxx has failures: true
      warning: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir -p /etc/hadoop/conf/Execmkdir -p /etc/hadoop/conf: Skipping because of failed dependencies
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir -p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::end: Dependency Usermapredxx has failures: true
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir -p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::end: Dependency Userhdfsxx has failures: true
      warning: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir -p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::end: Skipping because of failed dependencies
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Directory/etc/hadoop/conf/File/etc/hadoop/conf: Dependency Usermapredxx has failures: true
      notice: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Directory/etc/hadoop/conf/File/etc/hadoop/conf: Dependency Userhdfsxx has failures: true
      warning: /Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Directory/etc/hadoop/conf/File/etc/hadoop/conf: Skipping because of failed dependencies
      notice: /Stage2/Hdp-hadoop::Initialize/File/etc/hadoop/conf/ssl-server.xml.example: Dependency Usermapredxx has failures: true
      notice: /Stage2/Hdp-hadoop::Initialize/File/etc/hadoop/conf/ssl-server.xml.example: Dependency Userhdfsxx has failures: true
      warning: /Stage2/Hdp-hadoop::Initialize/File/etc/hadoop/conf/ssl-server.xml.example: Skipping because of failed dependencies

      Attachments

        1. AMBARI-2076.patch
          2 kB
          Sumit Mohanty
        2. AMBARI-2076-1.patch
          2 kB
          Siddharth Wagle

        Issue Links

          Activity

            People

              swagle Siddharth Wagle
              sumitmohanty Sumit Mohanty
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: