1
我使用kbastani/spark-neo4j與docker-compose分析我圖形的中介中心。的Neo4j - Mazerunner工作沒有響應
我的節點建立像這樣:
(n1:Node {id:1})-[r:NEXT {count:100}]->(n2:Node {id:2})
我忽略了日誌異常(因爲我不知道如何解決它):
mazerunner_1 | 16/11/29 08:27:51 INFO FileInputFormat: Total input paths to process : 1
mazerunner_1 | Exception in thread "main" org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Zero blocklocations for /neo4j/mazerunner/jobs/edgeList.txt. Name node is in safe mode.
mazerunner_1 | The reported blocks 0 needs additional 28 blocks to reach the threshold 0.9990 of total blocks 28.
mazerunner_1 | The number of live datanodes 0 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached.
mazerunner_1 | at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1678)
mazerunner_1 | at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1651)
mazerunner_1 | at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1625)
mazerunner_1 | at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:497)
mazerunner_1 | at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:322)
mazerunner_1 | at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
mazerunner_1 | at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
mazerunner_1 | at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
mazerunner_1 | at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
mazerunner_1 | at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
mazerunner_1 | at java.security.AccessController.doPrivileged(Native Method)
mazerunner_1 | at javax.security.auth.Subject.doAs(Subject.java:415)
mazerunner_1 | at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
mazerunner_1 | at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
我跑我的工作從Neo4j的瀏覽器,像這樣:
:GET /service/mazerunner/analysis/betweenness_centrality/NEXT
我可以在迷宮流道日誌中看到:
graphdb_1 | /var/lib/neo4j-community-2.2.3/..
graphdb_1 | [*] Waiting for messages. To exit press CTRL+C
graphdb_1 | 08:50:31.608 [qtp198725683-33] WARN o.a.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
graphdb_1 | Records exported: 20000
graphdb_1 | Records exported: 40000
graphdb_1 | Records exported: 60000
graphdb_1 | Records exported: 80000
graphdb_1 | Mazerunner Export Status: 100%
graphdb_1 | [x] Sent '{"path":"hdfs://hdfs:9000/neo4j/mazerunner/jobs/edgeList.txt","analysis":"betweenness_centrality","mode":"Unpartitioned"}'
再沒有什麼......半晌。
問:我怎樣才能使它運行?