Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11145

launch_container.sh problem when hive query with backqoute

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.1.0
    • None
    • None
    • Yarn   3.1.0

      Hive   3.1.0

      HDP   3.1.0.0-78

    Description

      When hive query start up a Distcp job as a MapReduce job,it was named as ”distcp:[clipped SQL context]“  by default,when the sql is [insert into mydb.newtb select * from mydb.oldtb], it's like "distcp:insert into mydb.tb...db.oldtb". And this name will be used in lancher.container.sh as the value of TIMELINE_FLOW_NAME_TAG

       

      When I use backquote on one of database name and table name,it will cause a bash problem.Like 

      export TIMELINE_FLOW_NAME_TAG="distcp: INSERT INTO mydb.ne ...db`.`oldtb` (Stage-1)"

      in shell script file.The error is

      [container route]/launch_container.sh: line 33: unexpected EOF while looking for matching ``'

       

      I can solve this by set mapreduce.job.name to a static name ,just avoid this problem. Perhaps the default naming convention for Distcp tasks can be changed,which SQL context is not included.

      Attachments

        Activity

          People

            Unassigned Unassigned
            gwbw cc
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: