Details
-
Bug
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
3.1.0
-
None
-
None
-
Yarn 3.1.0
Hive 3.1.0
HDP 3.1.0.0-78
Description
When hive query start up a Distcp job as a MapReduce job,it was named as ”distcp:[clipped SQL context]“ by default,when the sql is [insert into mydb.newtb select * from mydb.oldtb], it's like "distcp:insert into mydb.tb...db.oldtb". And this name will be used in lancher.container.sh as the value of TIMELINE_FLOW_NAME_TAG
When I use backquote on one of database name and table name,it will cause a bash problem.Like
export TIMELINE_FLOW_NAME_TAG="distcp: INSERT INTO mydb.ne ...db`.`oldtb` (Stage-1)"
in shell script file.The error is
[container route]/launch_container.sh: line 33: unexpected EOF while looking for matching ``'
I can solve this by set mapreduce.job.name to a static name ,just avoid this problem. Perhaps the default naming convention for Distcp tasks can be changed,which SQL context is not included.