1
,我沒有下載anaconda3,spark1.6.1,JAVA,混帳等運行星火...如何使用Jupyter筆記本(Anaconda3,Ubuntu的)
,我設置了環境這樣
$ nano .bashrc
export PATH="/home/moon/anaconda3/bin:$PATH"
export SCALA_HOME=/usr/local/src/scala/scala-2.12.1
export PATH=$SCALA_HOME/bin:$PATH
export SPARK_PATH=~/spark-1.6.1-bin-hadoop2.6
export PATH=$SPARK_PATH/bin:$PATH
export ANACONDA_ROOT=/usr/home/moon/anaconda3
export PYSPARK_PYTHON=$ANACONDA_ROOT/bin/python3
export PYSPARK_DRIVER_PYTHON="jupyter"
export PYSPARK_DRIVER_PYTHON_OPTS="notebook"
$. .bashrc
$cd spark-1.6.1-bin-hadoop2.6
$bin/pyspark
然後我可以連接筆記本jupyter(python3)
但我不能老是跑火花前)SC,sc.textFile
如何集成火花和jupyter
https://github.com/apache/incubator- toree#安裝 –
謝謝!我會嘗試它 –