星火碩士和工人通過本地主機不連接地址

在Linux操作系統（SUSE SLES 12）我看到了下面的連接錯誤（「無法連接」），其中星火從屬進程也影響旁邊的「pyspark安裝星火包裝後「例子，拒絕連接。任何提示如何通過本地主機地址激活端口7077連接是值得歡迎的。部分問題可能是默認的Linux防火牆設置。星火碩士和工人通過本地主機不連接地址

防火牆命令來打開本地主機地址：

sudo iptables -A INPUT -s 127.0.0.1 -d 127.0.0.1 -j ACCEPT 
sudo iptables -A INPUT -s 127.0.0.1 -d zbra2016 -j ACCEPT

啓動星火大師 - 命令：

export SPARK_LOCAL_IP=zbra2016 
./sbin/stop-master.sh 
./sbin/start-master.sh 



16/04/19 10:12:29 INFO Master: Registered signal handlers for [TERM, HUP, INT] 
16/04/19 10:12:29 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 
16/04/19 10:12:29 INFO SecurityManager: Changing view acls to: linux1 
16/04/19 10:12:29 INFO SecurityManager: Changing modify acls to: linux1 
16/04/19 10:12:29 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(linux1); users with modify permissions: Set(linux1) 
16/04/19 10:12:30 INFO Utils: Successfully started service 'sparkMaster' on port 7077. 
16/04/19 10:12:30 INFO Master: Starting Spark master at spark://zbra2016:7077 
16/04/19 10:12:30 INFO Master: Running Spark version 1.6.1 
16/04/19 10:12:30 WARN Utils: Service 'MasterUI' could not bind on port 8080. Attempting port 8081. 
16/04/19 10:12:30 INFO Utils: Successfully started service 'MasterUI' on port 8081. 
16/04/19 10:12:30 INFO MasterWebUI: Started MasterWebUI at http://localhost:8081 
16/04/19 10:12:30 INFO Utils: Successfully started service on port 6066. 
16/04/19 10:12:30 INFO StandaloneRestServer: Started REST server for submitting applications on port 6066 
16/04/19 10:12:31 INFO Master: I have been elected leader! New state: ALIVE

啓動星火工人 - 命令：

./sbin/stop-slave.sh 
./sbin/start-slave.sh spark://zbra2016:7077

日誌文件顯示「無法連接錯誤消息「：

別名

/data/spark/spark/logs/spark-linux1-org.apache.spark.deploy.worker.Worker-1-zbra2016.out 
16/04/19 10:15:46 INFO Worker: Retrying connection to master (attempt # 1) 
16/04/19 10:15:46 INFO Worker: Connecting to master zbra2016:7077... 
16/04/19 10:15:47 WARN Worker: Failed to connect to master zbra2016:7077 
java.io.IOException: Failed to connect to zbra2016/127.0.0.1:7077

測試連接：zbra2016 =本地主機

[email protected]:/data/spark/spark> ping zbra2016 
PING localhost (127.0.0.1) 56(84) bytes of data. 
64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.022 ms

來源

2016-04-19 Claude Falbriard

我們只是爲它找到一個解決方案在Linux的安裝iptables防火牆。我使用以下命令打開本地主機通信：

iptables -I INPUT 1 -p all -s localhost -d localhost -j ACCEPT

現在工作進程能夠通過本地主機端口連接到主服務器。

來源

2016-04-21 14:09:50

您可以通過防火牆更改允許端口7077的設置。嘗試： sudo ufw允許7077

來源

2017-12-24 07:59:31 seekanddestroy1991

星火碩士和工人通過本地主機不連接地址

回答

相關問題