2016-10-01 95 views
2

,下面的錯誤來了,在mongodb日誌中一個連接接受並立即結束。解決它?

$ bin/crawl conf/urls/seeds.txt tuto 1 未指定SOLRURL。跳過索引。 注入種子URL /e/apache-nutch/apache-nutch-2.3.1/runtime/local/bin/nutch注入conf/urls/seeds.txt -crawlId tuto InjectorJob:從2016-10-01開始18: 15:14 InjectorJob:注入urlDir:conf/urls/seeds.txt InjectorJob:使用類org.apache.gora.mongodb.store.MongoStore作爲Gora存儲類。 InjectorJob:java.lang.NullPointerException at java.lang.ProcessBuilder.start(ProcessBuilder.java:1010) at org.apache.hadoop.util.Shell.runCommand(Shell.java:482) at org.apache。 hadoop.util.Shell.run(Shell.java:455) at org.apache.hadoop.util.Shell $ ShellCommandExecutor.execute(Shell.java:702) at org.apache.hadoop.util.Shell.execCommand( (org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:646) at org。)。 apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:434) at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:281) 在org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:125) 在org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:348) 在org.apache.hadoop.mapreduce。作業$ 10.run(Job.java:1285) at org.apache.hadoop.mapreduce.Job $ 10.run(Job.java:1282) at java.security.AccessController.doPrivileged(Native Method) at javax.security .auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614) at org.apache.hadoop.mapreduce.Job.submit(Job.java :1282) at org.apache.hatil.Nutc org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303) at org.apache.nutch.util.Nutc hJob.waitForCompletion(NutchJob.java:115) at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:231) at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:252) at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:275) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.nutch.crawl。 InjectorJob.main(InjectorJob.java:284)錯誤:當我嘗試運行時,啓動Apache nutch與mongodb

回答

0

相信Nutch的最新版本的使用

# bin/nutch inject seedDirectory/ 

這至少爲我工作。

0

我剛好從gora-mongodb-mapping.xml文件中的Nutch的conf文件夾中刪除兩行即:

[field name="sitemaps" docfield="sitemaps" type="document"] 

[field name="stmPriority" docfield="stmPriority" type="int32"] 

解決了這個問題。希望它能幫助你..

相關問題