2017-03-17 16 views
1

,我沒有下載anaconda3,spark1.6.1,JAVA,混帳等運行星火...如何使用Jupyter筆記本(Anaconda3,Ubuntu的)

,我設置了環境這樣

$ nano .bashrc 
export PATH="/home/moon/anaconda3/bin:$PATH" 

export SCALA_HOME=/usr/local/src/scala/scala-2.12.1 
export PATH=$SCALA_HOME/bin:$PATH 

export SPARK_PATH=~/spark-1.6.1-bin-hadoop2.6 
export PATH=$SPARK_PATH/bin:$PATH  

export ANACONDA_ROOT=/usr/home/moon/anaconda3 
export PYSPARK_PYTHON=$ANACONDA_ROOT/bin/python3 

export PYSPARK_DRIVER_PYTHON="jupyter" 
export PYSPARK_DRIVER_PYTHON_OPTS="notebook" 

$. .bashrc 

$cd spark-1.6.1-bin-hadoop2.6 
$bin/pyspark 

然後我可以連接筆記本jupyter(python3)
但我不能老是跑火花前)SC,sc.textFile

如何集成火花和jupyter

+0

https://github.com/apache/incubator- toree#安裝 –

+0

謝謝!我會嘗試它 –

回答

2

請在下面添加。

PYSPARK_DRIVER_PYTHON=ipython PYSPARK_DRIVER_PYTHON_OPTS="notebook" ./bin/pyspark 

下面還要檢查: Apache Spark: How to use pyspark with Python 3

我面臨水蟒蟒3一些兼容性的問題,我切換到水蟒蟒2.7

+0

我加了它,但它沒有工作..任何謝謝.. –