Nutch的路徑錯誤

http://wiki.apache.org/nutch/NutchTutorial 和http://www.nutchinstall.blogspot.com/Nutch的路徑錯誤

當我走命令

bin/nutch crawl urls -dir crawl -depth 3 -topN 5

我有

LinkDb: adding segment: file:/C:/cygwin/home/LeHung/apache-nutch-1.4-bin/runtime/local/crawl/segments/201203
LinkDb: adding segment: file:/C:/cygwin/home/LeHung/apache-nutch-1.4-bin/runtime/local/crawl/segments/201203
Exception in thread "main" org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file:/C:/cygwin/home/LeHung/apache-nutch-1.4-bin/runtime/local/crawl/segments/20120301221729/parse_data 
Input path does not exist: file:/C:/cygwin/home/LeHung/apache-nutch-1.4-bin/runtime/local/crawl/segments/20120301221754/parse_data 
Input path does not exist: file:/C:/cygwin/home/LeHung/apache-nutch-1.4-bin/runtime/local/crawl/segments/20120301221804/parse_data 
     at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:190) 
     at org.apache.hadoop.mapred.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:44) 
     at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:201) 
     at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:810) 
     at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:781) 
     at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730) 
     at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1249) 
     at org.apache.nutch.crawl.LinkDb.invert(LinkDb.java:175) 
     at org.apache.nutch.crawl.LinkDb.invert(LinkDb.java:149) 
     at org.apache.nutch.crawl.Crawl.run(Crawl.java:143) 
     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) 
     at org.apache.nutch.crawl.Crawl.main(Crawl.java:55)

我使用的cygwin，窗口運行的nutch此錯誤

來源

2012-03-01 thereds1106

看起來像沒有所需的parse_data子文件夾段內有一些目錄。你有沒有運行爬網之前，然後刪除一些目錄？ – javanna 2012-03-02 09:18:12

我有同樣的問題 – Aftershock 2012-03-21 21:37:53

我有類似的問題。我刪除了數據庫和目錄。之後，它運行良好。

來源

2012-03-21 21:40:35 Aftershock

它似乎適合我。但是如果我爬了好幾天，那就不會那麼好。 – MrROY 2012-03-23 07:36:00

Nutch的路徑錯誤

回答

相關問題