2016-10-19 141 views
3

我在我的四個節點羣集上安裝了Hadoop。我還在其中的每一個上安裝了Apache Spark。我可以不用密碼從主人ssh到每個奴隸。我也可以啓動我的主節點。然而,當我嘗試使用/opt/spark/sbin/start-all.sh運行星火,我得到以下錯誤:啓動Apache Spark羣集

starting org.apache.spark.deploy.master.Master, logging to /opt/spark/logs/spark-hduser-org.apache.spark.deploy.master.Master-1-lebron.out 
doublet: chown: changing ownership of ‘/opt/spark/logs’: Operation not permitted 
doublet: starting org.apache.spark.deploy.worker.Worker, logging to /opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-doublet.out 
doublet: /opt/spark/sbin/spark-daemon.sh: line 149: /opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-doublet.out: Permission denied 
kyrie: chown: changing ownership of ‘/opt/spark/logs’: Operation not permitted 
kyrie: starting org.apache.spark.deploy.worker.Worker, logging to /opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-kyrie.out 
kyrie: /opt/spark/sbin/spark-daemon.sh: line 149: /opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-kyrie.out: Permission denied 
lebron: starting org.apache.spark.deploy.worker.Worker, logging to /opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-lebron.out 
jr: chown: changing ownership of ‘/opt/spark/logs’: Operation not permitted 
jr: starting org.apache.spark.deploy.worker.Worker, logging to /opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-jr.out 
jr: /opt/spark/sbin/spark-daemon.sh: line 149: /opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-jr.out: Permission denied 
doublet: failed to launch org.apache.spark.deploy.worker.Worker: 
doublet: tail: cannot open ‘/opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-doublet.out’ for reading: No such file or directory 
doublet: full log in /opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-doublet.out 
kyrie: failed to launch org.apache.spark.deploy.worker.Worker: 
kyrie: tail: cannot open ‘/opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-kyrie.out’ for reading: No such file or directory 
jr: failed to launch org.apache.spark.deploy.worker.Worker: 
kyrie: full log in /opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-kyrie.out 
jr: tail: cannot open ‘/opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-jr.out’ for reading: No such file or directory 
jr: full log in /opt/spark/logs/spark-hduser-org.apache.spark.deploy.worker.Worker-1-jr.out 

(我的電腦被命名爲勒布朗(主),凱里,JR,雙峯(工))

請幫忙!!!

回答

1

看看喜歡到/ opt /火花文件夾沒有權限來寫入日誌文件 給予充分的權限: - 須藤搭配chmod -R 777 /選擇/火花 也是檢查的/ opt /火花文件夾用戶:組具有用於所有的機器(主站和從站兩者)相同的值,否則運行此命令 須藤CHOWN -R用戶名:組名的/ opt /火花

0

在所有節點上配置密碼較少的ssh。