Cloudera Hadoop沒有運行hadoop 1.0.4？

Question

我已經寫了一個hadoop 1.0.4應用程序，在半分佈模式下本地運行良好。我還在集羣上安裝了Cloudera Hadoop 4。我認爲CDH4運行hadoop 1.0.4是因爲它在hadoop網站上列爲穩定，但似乎並非如此。當我跑我的羣，我得到了下面的錯誤上的應用：就在我assmption

12/11/27 16:14:38 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 
12/11/27 16:14:38 INFO input.FileInputFormat: Total input paths to process : 16 
12/11/27 16:14:39 INFO mapred.JobClient: Running job: job_201211271520_0004 
12/11/27 16:14:40 INFO mapred.JobClient: map 0% reduce 0% 
12/11/27 16:14:50 INFO mapred.JobClient: Task Id : attempt_201211271520_0004_m_000013_0, Status : FAILED 
Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected 
12/11/27 16:14:50 INFO mapred.JobClient: Task Id : attempt_201211271520_0004_m_000000_0, Status : FAILED 
... and so on... 

我是，這是因爲CHD4不是用Hadoop 1.0.4兼容嗎？如果有的話，是否有人知道什麼版本與hadoop 1.0.4兼容？我寧願切換cloudera軟件，而不是重寫我的應用程序。

Answer 1

你是對的; CDH3使用版本0.20.2，CDH4使用版本2.0.0。 Hadoop版本的命名是一團糟，我不假裝理解它。但它看起來像你可能能夠基於在this blog post by Cloudera下列規定使用CDH3：

"The CDH3 distribution incorporated the 0.20.2 Apache Hadoop release plus the features of the 0.20.append and 0.20.security branches that collectively are now known as 「1.0.」 The Apache Hadoop in CDH3 has been the equivalent of the recently announced Apache Hadoop 1.0 for approximately a year now."

如果是這樣的話，我會給CDH3一試。如果它不起作用，你可能只需要尋找除了Cloudera的安裝之外的東西。