我試圖在virtualbox虛擬機(RHEL 6.5,8GB RAM,100GB HDD)中的僞分佈式集羣上運行一個MR作業,但提交作業後只能在此處找到。Hadoop YARN作業提交後狀態保持未定義
信息:mapreduce.Job:正在運行的作業:job_1437483993_001
應用跟蹤URL(http://localhost:8088/cluster/applicationID)這樣表示結果:
用戶:根
名稱: grep-search
應用程序類型:mapreduce
狀態:接受
FinalStatus:未定義
我曾嘗試:
- 修改紗的site.xml和mapred-site.xml中最小和最大分配內存遵循教程(http://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/)
- 確保磁盤空間足夠用於容納新作業。
jps
顯示所有服務正常運行。
但沒有運氣。請引導我。
編輯: 這裏的日誌:
[[email protected] ~]# hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar grep /user/pradeep output23 'dfs[a-z.]+' SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. 16/04/27 10:21:09 INFO client.RMProxy: Connecting to ResourceManager at /127.0.0.1:8032 16/04/27 10:21:09 WARN mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String). 16/04/27 10:21:09 INFO input.FileInputFormat: Total input paths to process : 4 16/04/27 10:21:10 INFO mapreduce.JobSubmitter: number of splits:4 16/04/27 10:21:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1461732411884_0001 16/04/27 10:21:11 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources. 16/04/27 10:21:11 INFO impl.YarnClientImpl: Submitted application application_1461732411884_0001 16/04/27 10:21:11 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1461732411884_0001/ 16/04/27 10:21:11 INFO mapreduce.Job: Running job: job_1461732411884_0001
我試圖運行一個簡單的現有示例應用程序來測試基礎設施 'hadoop jar hadoop-examples.jar grep input output'dfs [az。] +'' –
按照你的建議我試着運行一個不同的map-reduce由PIG腳本生成的代碼。提交給resorcemanager後,該工作仍然凍結。 –