Tez在HDP 2.1上崩潰

當我嘗試在終端中運行TEZ作業時，我的配置單元崩潰。我在具有5個節點的羣集上安裝了HDP 2.1。操作系統：Redhat EnterpriseTez在HDP 2.1上崩潰

誰能幫幫我？ :)從應用程序跟蹤

登錄：

HDP: 2.1 
User: hdfs 
Name: HIVE-9fd632e5-d76a-4e0a-8845-0c1f0af52f5c 
Application Type: TEZ 
Application Tags: 
State: FAILED 
FinalStatus: FAILED 
Started: 1-Jul-2014 12:03:22 
Elapsed: 4sec 
Tracking URL: History 
Diagnostics: 
Application application_1404208879507_0002 failed 2 times due to AM Container for appattempt_1404208879507_0002_000002 exited with exitCode: 1 due to: Exception from container- launch:  org.apache.hadoop.util.Shell$ExitCodeException: 
org.apache.hadoop.util.Shell$ExitCodeException: 
at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) 
at org.apache.hadoop.util.Shell.run(Shell.java:418) 
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) 
at   org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecu tor.java:195) 
at  org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch .java:300) 
at  org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch .java:81) 
at java.util.concurrent.FutureTask.run(FutureTask.java:262) 
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
at java.lang.Thread.run(Thread.java:745) 
Container exited with a non-zero exit code 1 
.Failing this attempt.. Failing the application.

並在終端：

Total jobs = 1 
Launching Job 1 out of 1 
Tez session was closed. Reopening... 
Session re-established. 
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

來源

2014-07-01 Merl

的原因可能是運行作業的用戶的ID不能低於1000轉到到TaskTracker的日誌文件，看看是否有這樣的消息：

INFO org.apache.hadoop.mapred.TaskController: Reading task controller configuration /etc/hadoop/taskcontroller.cfg 
INFO. org.apache.hadoop.mapred.TaskController: requested user 
hdfs has id 201, which is below the minimum allowed 1000

如果這是的情況下，那麼你可以做到以下幾點：

usermod -u 10000 hdfs

來源

2014-07-01 13:13:55 Balduz

對不起，沒有工作，我編輯我的帖子更多的信息:) – Merl

我認爲特茲是非常不穩定。只有選擇* from沒有clausules正在工作的時刻..我在Hue上登錄爲HDFS，併發起了正常的select * from ...查詢。感謝您的快速回答！ – Merl

我覺得特茲非常不穩定。只有選擇* from沒有clausules正在工作的時刻..我在Hue上登錄爲HDFS，併發起了正常的select * from ...查詢。感謝您的快速回答！

來源

2014-07-01 13:48:16 Merl

「應用程序application_1404208879507_0002由於AM容器for失敗2次」這一行顯示Tez Application Master可能無法啓動。這可能是由於各種原因。

查找原因的最簡單方法是調用「bin/yarn logs -applicationId application_1404208879507_0002」獲取的應用程序日誌。導致此問題的最常見問題通常是在啓動java進程時導致ClassNotFound錯誤的一些安裝/配置錯誤。

來源

2015-03-21 20:32:25

Tez在HDP 2.1上崩潰

回答

相關問題