[Hive&Tez] java.lang.IllegalArgumentException: Can not create a Path from an empty string

 

hive 3.1.3

Tez 0.10.2

 

 

Hive쿼리로 insert into나 select count(1)할 때 아래 에러 발생

0: jdbc:hive2://mymn001> select count(1) from bt_car_mst; INFO  : Subscribed to counters: [] for queryId: hive_20260121063127_333ffb11-45f1-4faf-b461-3dc57a9a93c0 INFO  : Tez session hasn't been created yet. Opening session ERROR : Failed to execute tez graph. java.lang.IllegalArgumentException: Can not create a Path from an empty string         at org.apache.hadoop.fs.Path.checkPathArg(Path.java:172) ~[hadoop-common-3.3.4-101.jar:?]         at org.apache.hadoop.fs.Path.<init>(Path.java:184) ~[hadoop-common-3.3.4-101.jar:?]         at org.apache.hadoop.fs.Path.<init>(Path.java:119) ~[hadoop-common-3.3.4-101.jar:?]         at org.apache.hadoop.hive.ql.exec.tez.DagUtils.addTempResources(DagUtils.java:1041) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeTempFilesFromConf(DagUtils.java:931) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.ensureLocalResources(TezSessionState.java:610) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.openInternal(TezSessionState.java:287) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession.openInternal(TezSessionPoolSession.java:124) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:245) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.exec.tez.TezTask.ensureSessionHasResources(TezTask.java:368) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:195) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157) ~[hive-exec-3.1.3-101.jar:3.1.3-101]         at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:224) ~[hive-service-3.1.3-101.jar:3.1.3-101]         at org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:87) ~[hive-service-3.1.3-101.jar:3.1.3-101]         at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:316) ~[hive-service-3.1.3-101.jar:3.1.3-101]         at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_472]         at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_472]         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) ~[hadoop-common-3.3.4-101.jar:?]         at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:329) ~[hive-service-3.1.3-101.jar:3.1.3-101]         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_472]         at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_472]         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_472]         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_472]         at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_472] ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask INFO  : Completed executing command(queryId=hive_20260121063127_333ffb11-45f1-4faf-b461-3dc57a9a93c0); Time taken: 0.534 seconds Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask (state=08S01,code=1)

 

 

 

hive-env.sh에 아래 설정을 확인하는데 이상한 문자열이 없는지 확인한다.

export HIVE_AUX_JARS_PATH

 

나는 아래의 경우였다.

{% if iceberg_table_enabled %}   export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:{{ieberg_hive_rutime_jar_path}} {% endif %}

 

아이스버그는 사용하지 않아서 아래와 같이 바꿔주었다.

{% if iceberg_table_enabled %}   export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH} {% endif %}