模糊比較兩列

我有一個CSV文件，其中包含搜索字詞（數字和文本），我想與其他字詞（數字和文本）的列表進行比較，以確定是否存在任何匹配項或潛在匹配項。然後，我想將所有結果寫入新的CSV以進行手動審覈。我正在使用fuzzywuzzy插件創建一個「分數」來確定術語之間的匹配程度。理想情況下，我可以根據比例進行過濾。模糊比較兩列

我當前的代碼將文件行一對一地比較，而不是將第一個文件中的一行與第二行中的所有行進行比較;這是我需要的。

如何針對file1中的每一行對file2中的所有行執行模糊查找？

from fuzzywuzzy import fuzz 
import csv 
from itertools import zip_longest 

f = open('FuzzyMatch2.csv', 'wt') 
writer = csv.writer(f, lineterminator = '\n') 


file1_loc = 'LookUp.csv' 
file2_loc = 'Prod.csv' 

file1 = csv.DictReader(open(file1_loc, 'r'), delimiter=',', quotechar='"') 
file2 = csv.DictReader(open(file2_loc, 'r'), delimiter=',', quotechar='"') 

for row in file1: 
    for l1, l2 in zip_longest(file1, file2): 
     if all((l1, l2)): 
      partial_ratio = fuzz.token_sort_ratio(str(l1['SearchTerm']), str(l2['Description']))  

     a = [l1,l2,partial_ratio] 
     writer.writerow(a) 

f.close()

下面是上述代碼更清潔的版本，但它仍然有問題。代碼給出了一個錯誤

IndexError: list index out of range

任何想法如何獲得範圍內的列表和代碼工作？

from fuzzywuzzy import process 
import csv 

save_file = open('FuzzyResults.csv', 'wt') 
writer = csv.writer(save_file, lineterminator = '\n') 

def parse_csv(path): 
    with open(path,'r') as f: 
     for row in f: 
      row = row.split() 
      yield row 


if __name__ == "__main__": 
    ## Create lookup dictionary by parsing the products csv 
    data = {} 
    for row in parse_csv('Prod.csv'): 
     data[row[0]] = row[1] 

    ## For each row in the lookup compute the partial ratio 
    for row in parse_csv("LookUp.csv"): 

     for found, score in process.extract(row, data, limit=100): 
      if score >= 10: 
       print('%d%% partial match: "%s" with "%s" ' % (score, row, found)) 
       Digi_Results = [score, row, found] 
       writer.writerow(Digi_Results) 


save_file.close()

來源

2015-05-19 djm457

問題在哪裏？ –

如何針對file1中的每一行對file2中的所有行執行模糊查找？ – djm457

下面的代碼將工作。確保安裝了最新的FuzzyWuzzy - 最新更新28APR15。否則，您將收到一個「unicode」錯誤。希望這可以幫助！

from fuzzywuzzy import process 
import csv 

save_file = open('FuzzyResults3.csv', 'w') 
writer = csv.writer(save_file, lineterminator = '\n') 

def parse_csv(path): 

    with open(path,'r') as f: 
     reader = csv.reader(f, delimiter=',') 
     for row in reader: 
      yield row 


if __name__ == "__main__": 
    ## Create lookup dictionary by parsing the products csv 
    data = {} 
    for row in parse_csv('File1.csv'): 
     data[row[0]] = row[1] 

    ## For each row in the lookup compute the partial ratio 
    for row in parse_csv("File2.csv"): 
     #print(process.extract(row,data, limit = 100)) 
     for found, score, matchrow in process.extract(row, data, limit=100): 
      if score >= 60: 
       print('%d%% partial match: "%s" with "%s" ' % (score, row, found)) 
       Digi_Results = [score, row, found] 
       writer.writerow(Digi_Results) 


save_file.close()

來源

2015-06-01 23:00:34 djm457

我的猜測是，也許你想改變row.split()到row.split(',')，但肯定沒有看到輸入文件不能說的，也是錯誤的確切追蹤。

來源

2015-05-29 04:24:57 maxymoo

模糊比較兩列

回答

相關問題