SAP HANA Vora：未能啓動SparkController

最近我開始在AWS上開發SAP HANA Vora 1.0。我配置hanaes-site.xml文件讀取沃拉表，但試圖與./hanaes啓動命令，啓動控制器的時候，我收到此錯誤：SAP HANA Vora：未能啓動SparkController

SLF4J: Class path contains multiple SLF4J bindings. 

SLF4J: Found binding in [jar:file:/usr/sap/spark/controller/lib/spark-sap-datasources-1.0.0-assembly.jar!/org/slf4j/impl/StaticLoggerBinder.class] 

SLF4J: Found binding in [jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] 

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 

SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 

16/04/21 10:29:31 INFO HanaESConfig: Loaded HANA Extended Store Configuration 
Spark assembly is not available in class path. Creating Custom class loader from HDFS 
Binding with hive-site.xml foind at /usr/sap/spark/controller/conf 

16/04/21 10:29:34 INFO Server: Starting Spark Controller 

16/04/21 10:29:34 INFO HanaESConfig: Loaded HANA Extended Store Configuration 

16/04/21 10:29:51 ERROR LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerBlockManagerAdded(1461234591659,BlockManagerId(2, master.cluster, 41198),1111511531)

能否請你幫我解決這個問題？

來源

2016-04-21 PrzemekS

「星火裝配不類路徑可用」

你應該把位於/ usr/SAP /火花/控制器火花彙編文件/ lib中/外，並確保hanaes.xml具有屬性：

<property> 
<name>sap.hana.es.spark.yarn.jar</name> 
<value>file:///usr/sap/spark/controller/lib/external/spark-assembly-<spark version>-hadoop<hadoop version>.jar</value> 
<final>true</final> 
</property>

如果您的羣集上已安裝Spark，則可以在$ SPARK_HOME/lib中找到spark組件文件。如果你沒有在集羣上安裝星火，可以從http://spark.apache.org/downloads.html

感謝

============更新下載========= ========

在hanaes-site.xml中，「sap.hana.es.lib.location」應指向「hdfs：/// sap/hana/spark/libs/thirdparty /」。

它應該看上去象下面這樣：

<property> 
<name>sap.hana.es.spark.yarn.jar</name> 
<value>file:///usr/sap/spark/controller/lib/external/spark-assembly-1.4.1-hadoop2.6.0.jar</value> 
<final>true</final> 
</property> 
<property> 
<name>sap.hana.es.server.port</name> 
<value>7860</value> 
<final>true</final> 
</property> 
<property> 
<name>sap.hana.es.lib.location</name> 
<value>hdfs:///sap/hana/spark/libs/thirdparty/</value> 
<final>true</final> 
</property>

另外，我也建議你使用Vora 1.2 AWS developer edition

來源

2016-04-21 20:37:38

SAP HANA Vora：未能啓動SparkController

回答

相關問題