錯誤而讀/寫（Hadoop的）

我跟着this教程安裝Hadoop的。那麼，如果我使用\ usr \ local \ hadoop作爲hadoop.tmp.dir，一切正常。由於我在這個分區中的空間非常小，我試圖將此值設置爲/ NEW_partition /（ext4），但我總是得到一些java錯誤。我想這是因爲hadoop無法寫入此分區。我怎樣才能使它工作？錯誤而讀/寫（Hadoop的）

::::編輯:::: 完整的執行結果。

[email protected]:/usr/local/hadoop-0.20.203.0$ bin/hadoop jar hadoop-examples-0.20.203.0.jar wordcount /MY_STORAGE/tmp1/gutnb /MY_STORAGE/tmp1/gutnbou 


12/02/12 02:56:00 INFO input.FileInputFormat: Total input paths to process : 3 

12/02/12 02:56:00 INFO mapred.JobClient: Running job: job_201202120255_0001 

12/02/12 02:56:01 INFO mapred.JobClient: map 0% reduce 0% 

12/02/12 02:56:09 INFO mapred.JobClient: Task Id : attempt_201202120255_0001_m_000004_0, Status : FAILED 

java.lang.Throwable: Child Error 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) 

Caused by: java.io.IOException: Task process exit with nonzero status of 126. 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) 


12/02/12 02:56:09 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000004_0&filter=stdout 

12/02/12 02:56:09 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000004_0&filter=stderr 

12/02/12 02:56:15 INFO mapred.JobClient: Task Id : attempt_201202120255_0001_m_000004_1, Status : FAILED 

java.lang.Throwable: Child Error 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) 

Caused by: java.io.IOException: Task process exit with nonzero status of 126. 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) 


12/02/12 02:56:15 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000004_1&filter=stdout 

12/02/12 02:56:15 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000004_1&filter=stderr 

12/02/12 02:56:21 INFO mapred.JobClient: Task Id : attempt_201202120255_0001_m_000004_2, Status : FAILED 

java.lang.Throwable: Child Error 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) 

Caused by: java.io.IOException: Task process exit with nonzero status of 126. 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) 


12/02/12 02:56:21 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000004_2&filter=stdout 

12/02/12 02:56:21 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000004_2&filter=stderr 

12/02/12 02:56:33 INFO mapred.JobClient: Task Id : attempt_201202120255_0001_m_000003_0, Status : FAILED 

java.lang.Throwable: Child Error 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) 

Caused by: java.io.IOException: Task process exit with nonzero status of 126. 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) 


12/02/12 02:56:33 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000003_0&filter=stdout 

12/02/12 02:56:33 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000003_0&filter=stderr 

12/02/12 02:56:39 INFO mapred.JobClient: Task Id : attempt_201202120255_0001_m_000003_1, Status : FAILED 

java.lang.Throwable: Child Error 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) 

Caused by: java.io.IOException: Task process exit with nonzero status of 126. 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) 


12/02/12 02:56:39 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000003_1&filter=stdout 

12/02/12 02:56:39 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000003_1&filter=stderr 

12/02/12 02:56:45 INFO mapred.JobClient: Task Id : attempt_201202120255_0001_m_000003_2, Status : FAILED 

java.lang.Throwable: Child Error 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) 

Caused by: java.io.IOException: Task process exit with nonzero status of 126. 
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) 


12/02/12 02:56:45 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000003_2&filter=stdout 

12/02/12 02:56:45 WARN mapred.JobClient: Error reading task outputhttp://FreeLnx:50060/tasklog?plaintext=true&attemptid=attempt_201202120255_0001_m_000003_2&filter=stderr 

12/02/12 02:56:51 INFO mapred.JobClient: Job complete: job_201202120255_0001 

12/02/12 02:56:51 INFO mapred.JobClient: Counters: 4 

12/02/12 02:56:51 INFO mapred.JobClient: Job Counters 

12/02/12 02:56:51 INFO mapred.JobClient:  SLOTS_MILLIS_MAPS=24115 

12/02/12 02:56:51 INFO mapred.JobClient:  Total time spent by all reduces waiting after reserving slots (ms)=0 

12/02/12 02:56:51 INFO mapred.JobClient:  Total time spent by all maps waiting after reserving slots (ms)=0 

12/02/12 02:56:51 INFO mapred.JobClient:  SLOTS_MILLIS_REDUCES=0

來源

2012-02-11 kunal

什麼錯誤？ – 2012-02-11 19:15:30

信息mapred.JobClient：任務標識：attempt_201202112219_0001_m_000004_0，狀態：失敗的java.lang.Throwable：兒童錯誤 \t在org.apache.hadoop.mapred.TaskRunner.run（TaskRunner.java:271）產生的原因：java的。 io.IOException：任務進程退出與126 \t非零狀態在org.apache.hadoop.mapred.TaskRunner.run（TaskRunner.java:258） – kunal 2012-02-11 20:48:10

什麼作業日誌文件說？ – 2012-02-11 21:04:25

你可能需要檢查你的權限配置mapred.local.dir目錄，默認這是$ {} hadoop.tmp.dir/mapred /本地。父目錄及其所有的內容必須由運行的TaskTracker守護進程，爲任務能夠有效內它來寫瞬態數據（以及做其他事情）的用戶所擁有。

來源

2012-11-17 09:47:23

錯誤而讀/寫（Hadoop的）

回答

相關問題