2015-12-22 37 views
0

我想用oozie(horton works)運行sqoop。這是我第一次嘗試運行Oozie的工作流程,我得到以下錯誤

Invoking Sqoop command line now 
1811 [main] WARN org.apache.sqoop.tool.SqoopTool - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration. 
2015-12-21 16:58:45,913 WARN [main] tool.SqoopTool (SqoopTool.java:loadPluginsFromConfDir(177)) - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration. Intercepting System.exit(1) 
<<< Invocation of Main class completed 
<<< Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1] Oozie Launcher failed, finishing Hadoop job gracefully Oozie Launcher, uploading action data to HDFS sequence file: hdfs://****/user/root/oozie-oozi/0000006-151121191305655-oozie-oozi-W/sqoop-node--sqoop/action-data.seq 
2015-12-21 16:58:45,971 INFO [main] zlib.ZlibFactory (ZlibFactory.java:<clinit>(49)) - Successfully loaded & initialized native-zlib library 
2015-12-21 16:58:45,973 INFO [main] compress.CodecPool (CodecPool.java:getCompressor(153)) - Got brand-new compressor [.deflate] Oozie Launcher ends 
2015-12-21 16:58:45,995 INFO [main] mapred.Task (Task.java:done(1038)) - Task:attempt_1448133067660_0066_m_000000_0 is done. And is in the process of committing 
2015-12-21 16:58:46,033 INFO [main] mapred.Task (Task.java:commit(1199)) - Task attempt_1448133067660_0066_m_000000_0 is allowed to commit now 
2015-12-21 16:58:46,044 INFO [main] output.FileOutputCommitter (FileOutputCommitter.java:commitTask(482)) - Saved output of task 'attempt_1448133067660_0066_m_000000_0' to hdfs://ip-10-39-154-114:8020/user/root/oozie-oozi/0000006-151121191305655-oozie-oozi-W/sqoop-node--sqoop/output/_temporary/1/task_1448133067660_0066_m_000000 
2015-12-21 16:58:46,081 INFO [main] mapred.Task (Task.java:sendDone(1158)) - Task 'attempt_1448133067660_0066_m_000000_0' done. 

回答

1

不,這是沒有必要設置$SQOOP_CONF_DIR但它的好,如果你設置它。 ,並且您有一些與您的workflow.xml相關的問題。有些情況下會出現這樣的問題:

  1. workflow.xml有一些問題,像<command>...</command>裏面沒有正確傳遞參數。
  2. sqoop * .jar不存在。等

,但如果你要檢查的真正問題是什麼,那麼你可以通過登錄紗在命令行上通過檢查:

yarn logs -applicationId application_<app_id> 

或 你也可以看到你的日誌透過網路使用者介面在:

<IP_WHERE_HADOOP_DEPOLYED>:8088/cluster 
+0

>>>調用Sqoop命令行現在>>> 9175 [主] WARN org.apache.sqoop.tool.SqoopTool - $ SQOOP_CONF_DIR未在 環境中設置。無法檢查其他配置。 <<<完成<<<主要類的調用 失敗了Oozie啓動,主要類 [org.apache.oozie.action.hadoop.SqoopMain],退出 代碼[1] Oozie的啓動失敗,擺好整理Hadoop的作業 Oozie啓動器,將操作數據上傳到HDFS序列文件:Oozie啓動器結束 – user2017