0
我在做Cloudera教程，並執行「4.使用spark-submit提交應用程序」。我做錯了什麼，以便運行教程失敗？我從/ bin文件夾中找到spark-shell和spark-submit，但沒有Spark-slass。Spark提交失敗 -/opt/cloudera/parcels/CDH/bin/spark-class：沒有這樣的文件或目錄
https://www.cloudera.com/documentation/enterprise/5-5-x/topics/spark_streaming.html#streaming
export SPARK_HOME="/opt/cloudera/parcels/CDH"
spark-submit --master local[2] --conf
"spark.dynamicAllocation.enabled=false" --jars
$SPARK_HOME/lib/spark/lib/spark-examples.jar kafka_wordcount_keke.py k
localhost:2181 POCTopicKeke1
[[email protected] lib]$ spark-submit --master local[2] --jars $SPARK_HOME/lib/spark/lib/spark-examples.jar kafka_wordcount_keke.py localhost:2181 POCTopicKeke1
/log/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/bin/../lib/spark/bin/spark-submit: line 27: /opt/cloudera/parcels/CDH/bin/spark-class: No such file or directory
/log/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/bin/../lib/spark/bin/spark-submit: line 27: exec: /opt/cloudera/parcels/CDH/bin/spark-class: cannot execute: No such file or directory
[[email protected] lib]$
您的鏈接用於CDH 5.5 ...您正在使用5.12 –
您可以在https://www.cloudera.com/documentation/enterprise/latest/topics/spark_streaming.html#streaming –
中找到最新文檔你的意思是SPARK_HOME指向錯誤的路徑？如果CHH版本是5.12，它是否與spark-submit命令有所不同？ – Keke