2014-11-05 71 views
0

我正在嘗試安裝: 1)使用Spark的羣集。 2)具有Hbase的集羣。EMR:主實例嘗試下載引導操作失敗

首次嘗試安裝使用Bootstrapping Spark添加集羣成功,但是,我使用了SSH錯誤密鑰,因此我必須重新安裝新密鑰。從那以後(從第二次嘗試),我在安裝上面的1和2時遇到了同樣的錯誤。

我下面從說明:https://aws.amazon.com/articles/ElasticMapReduce/4926593393724923

我的命令從AWS CLI: AWS EMR創建集羣--name GCSpark --ami版本3.2 --instance型m3.xlarge --instance-算上3 --ec2的屬性鍵名=密鑰對 - 應用程序名稱=蜂巢--bootstrap-行動路徑= S3://support.elasticmapreduce/spark/install-spark

Output from stderr.txt: + python install-spark-script BA 14/10/31 22:00:45 INFO guice.EmrFSBaseModule: Consistency disabled, using com.amazon.ws.emr.hadoop.fs.s3n.S3NativeFileSystem as FileSystem implementation. 14/10/31 22:00:46 INFO fs.EmrFileSystem: Using com.amazon.ws.emr.hadoop.fs.s3n.S3NativeFileSystem as filesystem implementation 14/10/31 22:00:47 INFO s3n.S3NativeFileSystem: Opening 's3://support.elasticmapreduce/spark/1.1.0/scala-2.10.3.tgz' for reading 14/10/31 22:01:06 INFO guice.EmrFSBaseModule: Consistency disabled, using com.amazon.ws.emr.hadoop.fs.s3n.S3NativeFileSystem as FileSystem implementation. 14/10/31 22:01:07 INFO fs.EmrFileSystem: Using com.amazon.ws.emr.hadoop.fs.s3n.S3NativeFileSystem as filesystem implementation 14/10/31 22:01:08 INFO s3n.S3NativeFileSystem: Opening 's3://support.elasticmapreduce/spark/1.1.0/spark-1.1.0.e.tgz' for reading /bin/cp: cannot stat /usr/share/aws/emr/emr-fs/lib/: No such file or directory Traceback (most recent call last): File "install-spark-script", line 120, in prepare_classpath() File "install-spark-script", line 52, in prepare_classpath subprocess.check_call() File "/usr/lib64/python2.6/subprocess.py", line 505, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '' returned non-zero exit status 1*

任何幫助將不勝感激。

謝謝!

+0

同樣的問題在這裏(試圖安裝火花)。我想aws只是關閉auth或類似的東西。[我正在編輯https://github.com/awslabs/emr-bootstrap-actions/blob/master/spark/1.1.1/install-spark-1.1.1 .e.py從其他地方下載必要的文件] – C19 2014-12-16 07:28:52

回答

相關問題