這是我的Python代碼。在兩個Python進程之間使用什麼IPC機制來共享多處理.Queue數據?
#!/usr/bin/env python
import multiprocessing
import time
def worker(q):
while True:
data = q.get()
print 'worker: got: %d' % data
if data == -1:
print 'worker: done'
break
def master():
q = multiprocessing.Queue()
p = multiprocessing.Process(target=worker, args=(q,))
p.start()
for i in range(5):
q.put(i)
print 'master: put: %d' % i
time.sleep(1)
q.put(-1)
p.join()
print 'master: done'
master()
print 'exiting ...'
這是在Debian 9 GNU/Linux系統上運行此代碼時的輸出。
$ python q.py
master: put: 0
worker: got: 0
master: put: 1
worker: got: 1
master: put: 2
worker: got: 2
master: put: 3
worker: got: 3
master: put: 4
worker: got: 4
worker: got: -1
worker: done
master: done
exiting ...
我試圖找到一些證據表明,主進程和 工作進程正在通信中的數據被放置在隊列中通過 套接字,消息隊列或共享內存。但我似乎無法找到支持它的任何證據。
$ ps -ef | grep python | grep -v grep; netstat -nopa | grep python; ipcs
lone 2914 9836 2 12:54 pts/1 00:00:00 python q.py
lone 2915 2914 0 12:54 pts/1 00:00:00 python q.py
(Not all processes could be identified, non-owned process info
will not be shown, you would have to be root to see it all.)
------ Message Queues --------
key msqid owner perms used-bytes messages
------ Shared Memory Segments --------
key shmid owner perms bytes nattch status
0x00000000 163840 lone 600 393216 2 dest
0x00000000 262145 lone 600 393216 2 dest
0x00000000 360450 lone 600 393216 2 dest
0x00000000 142344195 lone 600 524288 2 dest
0x00000000 101941252 lone 600 4194304 2 dest
0x00000000 950277 lone 600 524288 2 dest
0x00000000 118194183 lone 600 696320 2 dest
0x00000000 118292488 lone 600 4153344 2 dest
0x00000000 117899273 lone 600 4153344 2 dest
0x00000000 118226954 lone 600 696320 2 dest
0x00000000 123535371 lone 600 86016 2 dest
0x00000000 123338764 lone 600 1728512 2 dest
0x00000000 123240461 lone 600 1798144 2 dest
0x00000000 123568144 lone 600 86016 2 dest
0x00000000 137330705 lone 600 32768 2 dest
0x00000000 137232402 lone 600 81920 2 dest
0x00000000 29098003 lone 600 4194304 2 dest
0x00000000 137265172 lone 600 81920 2 dest
0x00000000 137297941 lone 600 151552 2 dest
0x00000000 35258391 lone 600 393216 2 dest
0x00000000 35291160 lone 600 12288 2 dest
0x00000000 35323929 lone 600 12288 2 dest
0x00000000 35356698 lone 600 393216 2 dest
0x00000000 35520539 lone 600 12288 2 dest
0x00000000 35422236 lone 600 393216 2 dest
0x00000000 35455005 lone 600 12288 2 dest
------ Semaphore Arrays --------
key semid owner perms nsems
- 如何將數據放入
multiprocessing.Queue
從 主進程轉移到工作進程? - 可以運行哪些命令來查找用於將
multiprocessing.Queue
中的數據從主進程傳輸到輔助進程的IPC機制的證據?
這是一個有趣的問題。 'multiprocessing'被設計爲跨平臺。我不確定是否使用POSIX IPC。 –
@cᴏʟᴅsᴘᴇᴇᴅ檢查John Zwinck的答案。 –