無法啓動部署的火花作業服務器錯誤org.slf4j.LoggerFactory未找到

我想在CDH 5.11上使用火花作業服務器，火花版本爲1.6.0 當我嘗試啓動spark jobserver部署的機器我得到這個錯誤日誌無法啓動部署的火花作業服務器錯誤org.slf4j.LoggerFactory未找到

[ERROR] [06/02/2017 15:30:14.966] [JobServer-akka.actor.default-dispatcher-3] [ActorSystem(JobServer)] Uncaught error from thread [JobServer-akka.actor.default-dispatcher-3] shutting down JVM since 'akka.jvm-ex$ 
java.lang.NoClassDefFoundError: org/slf4j/LoggerFactory 
at akka.event.slf4j.Logger$.apply(Slf4jLogger.scala:30) 
at akka.event.slf4j.SLF4JLogging$class.log(Slf4jLogger.scala:19) 
at akka.event.slf4j.Slf4jLogger.log$lzycompute(Slf4jLogger.scala:54) 
at akka.event.slf4j.Slf4jLogger.log(Slf4jLogger.scala:54) 
at akka.event.slf4j.Slf4jLogger$$anonfun$receive$1.applyOrElse(Slf4jLogger.scala:80) 
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) 
at akka.actor.ActorCell.invoke(ActorCell.scala:456) 
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) 
at akka.dispatch.Mailbox.run(Mailbox.scala:219) 
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) 
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) 
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) 
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) 
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) 
Caused by: java.lang.ClassNotFoundException: org.slf4j.LoggerFactory 
at java.net.URLClassLoader.findClass(URLClassLoader.java:381) 
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) 
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) 
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) 
... 14 more 

Uncaught error from thread [JobServer-akka.actor.default-dispatcher-3] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[JobServer] 
java.lang.NoClassDefFoundError: org/slf4j/LoggerFactory 
at akka.event.slf4j.Logger$.apply(Slf4jLogger.scala:30) 
at akka.event.slf4j.SLF4JLogging$class.log(Slf4jLogger.scala:19) 
at akka.event.slf4j.Slf4jLogger.log$lzycompute(Slf4jLogger.scala:54) 
at akka.event.slf4j.Slf4jLogger.log(Slf4jLogger.scala:54) 
at akka.event.slf4j.Slf4jLogger$$anonfun$receive$1.applyOrElse(Slf4jLogger.scala:80) 
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) 
at akka.actor.ActorCell.invoke(ActorCell.scala:456) 
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) 
at akka.dispatch.Mailbox.run(Mailbox.scala:219) 
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) 
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) 
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) 
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) 
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) 
Caused by: java.lang.ClassNotFoundException: org.slf4j.LoggerFactory 
at java.net.URLClassLoader.findClass(URLClassLoader.java:381) 
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) 
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) 
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) 
... 14 more

有沒有人面臨同樣的問題或提供一些幫助？

來源

2017-06-02 Reuben Borrison

這裏幾件事情！

你是如何部署的？問題似乎是，SLF4J jar如何從SJS類路徑中排除。它可能存在版本衝突。

並檢查用戶界面中的火花依賴關係。（並找到SLF4J !!）

你必須檢查scala版本; Spark版本和Spark-Job-Server版本，如果它們相互衝突!!!

對你來說，對於spark版本1.6.0;所選的scala版本應該是2.10.4。（沒有任何其他版本像2.11或2.12）

來源

2017-06-07 10:58:06

感謝您的評論，但問題已經解決！這與您提到的錯誤是一樣的，但除此之外，CDH中還有不正確的類路徑設置，因爲我沒有更新spark classpath.txt。更新完成後，效果很好。另外現在我使用不同的回購火花作業服務器（[bjoern的回購]）（https://github.com/bjoernlohrmann/spark-jobserver），它是爲幾個CDH版本而構建的！ –

無法啓動部署的火花作業服務器錯誤org.slf4j.LoggerFactory未找到

回答

相關問題