Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
I can repro by running the following combination of tests with this feature enabled (but it doesn't repro for me if I run the entire MiniTez test, or just one test)
mvn test -Phadoop-2 -Dtest=TestMiniTezCliDriver -Dqfile=alter_merge_orc.q,auto_join30.q,auto_sortmerge_join_11.q,filter_join_breaktask.q,insert_into1.q,mergejoin.q,metadata_only_queries_with_filters.q,scriptfile1.q
It fails as follows:
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"key":"238","value":"val_238"}
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:520)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:86)
... 17 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: [Error 20000]: Unable to initialize custom script.
at org.apache.hadoop.hive.ql.exec.ScriptOperator.process(ScriptOperator.java:416)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:852)
at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:87)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:852)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:97)
at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:164)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:510)
... 18 more
Caused by: java.io.IOException: Cannot run program "/grid/5/sershe/tez-autobuild/hive/itests/qtest/target/hive/hive-localDir-nm-1_2/usercache/sershe/appcache/application_1444328939776_0001/container_1444328939776_0001_01_000004/./testgrep": error=13, Permission denied
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
at org.apache.hadoop.hive.ql.exec.ScriptOperator.process(ScriptOperator.java:374)
... 24 more
Caused by: java.io.IOException: error=13, Permission denied
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.<init>(UNIXProcess.java:186)
at java.lang.ProcessImpl.start(ProcessImpl.java:130)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
... 25 more
I didn't dig deeper (i.e. minimizing what tests cause it), but it doesn't look like any of these tests use this file.
It passes with the feature disabled, although tests do take much longer 
Attachments
Issue Links
- is blocked by
-
TEZ-2873 Add an option to disable relocalization
-
- Open
-