在EC2上

Question

部署火花我有一個錯誤，當我部署在EC2 我用這個我TwitterStreaming-0.0.1-快照：

spark/bin/spark-submit --class streaming.java.TwitterStreaming --master spark://xxxxxxxx.us-west-2.compute.amazonaws.com:6066 --deploy-mode cluster application-jar TwitterStreaming-0.0.1-SNAPSHOT.jar 

的反應是：

{ 
    "action" : "CreateSubmissionResponse", 
    "message" : "Driver successfully submitted as driver-20150402200153-0000", 
    "serverSparkVersion" : "1.3.0", 
    "submissionId" : "driver-20150402200153-0000", 
    "success" : true 
} 

瀏覽器的我在下面出現錯誤：

driver-20150402210100-0001 streaming.java.TwitterStreaming  ERROR 1 512.0 MB stdout stderr java.io.FileNotFoundException: File file:/root/application-jar does not exist. 

Answer 1

application-jar在您的提交命令中似乎是額外的

spark/bin/spark-submit --class streaming.java.TwitterStreaming --master spark://xxxxxxxx.us-west-2.compute.amazonaws.com:6066 --deploy-mode cluster TwitterStreaming-0.0.1-SNAPSHOT.jar 

請務必提供完整的路徑TwitterStreaming-0.0.1-SNAPSHOT.jar