python multiprocessing starmap progressbar

Question

由於我需要在我的工作者函數中有幾個參數，所以我使用starmap，但是如何使用tqdm顯示進度？

from itertools import repeat 
from multiprocessing import Pool 

def func(i, a, b, c): 
    print(i, a, b, c) 

if __name__ == '__main__': 
    pool = Pool(thread_num) 
    a, b, c = 'a', 'b', 'c' 
    pool.starmap(func, zip(range(100), repeat(a), repeat(b), repeat(c))) 
    pool.close() 
    pool.join() 

那麼我如何使用tqdm來顯示pregress？

Answer 1

您應該創建一個進程來監視其他進程傳遞的信號並更新您的tqdm。一個最小的例子：

from multiprocessing import Queue, Pool, Process 

def listener(q, num): 
    tbar = tdqm(total = num) 
    for i in iter(q.get, None): 
     tbar.update() 
    tbar.close() 

def worker(q): 
    do something. 
    queue.put(1) 

if __name__ == "__main__": 
    .... 
    q.put(None) #when you finish your work, put a None signal to finish the listener.