比較多個文件中的文本並將相同的文件保存在一個位置

Question

我有一個文件夾中具有不同名稱的n個文本文件，我想比較文件中存在的文本，如果它們相同，則保留這些文件單獨的文件夾並從主文件夾中刪除。誰能幫我？

我迄今爲止代碼：

file1=open("F1.txt","r") 
file2=open("F2.txt","r") 
file3=open("F3.txt","r") 
file4=open("F4.txt","r") 
file5=open("F5.txt","r") 
list1=file1.readlines() 
list2=file2.readlines() 
list3=file3.readlines() 
list4=file4.readlines() 
list5=file5.readlines() 
for line1 in list1: 
    for line2 in list2: 
     for line3 in list3: 
      for line3 in list4: 
       for line4 in list5: 
        if line1.strip() in line2.strip() in line3.strip() in line4.strip() in line5.strip(): 
         print line1 
         file3.write(line1) 

Answer 1

見see if two files have the same content in python

爲了比較，你可以使用filecmp模塊（http://docs.python.org/library/filecmp.html）：

>>> import filecmp 
>>> filecmp.cmp('F1.txt, 'F2.txt') 
True 
>>> filecmp.cmp('F1.txt', 'F3.txt') 
False 

所以一個解決這將是這樣（根本不算高雅，但確實有效）：

import filecmp 
files = ['F1.txt', 'F2.txt', 'F3.txt', 'F4.txt', 'F5.txt'] 
comparisons = {} 
for itm in range(len(files)): 
    try: 
     res = filecmp.cmp(files[itm], files[itm+1]) 
     comparisons[str(files[itm]) + ' vs ' + str(files[itm+1])] = res 
    except: 
     pass 
    try: 
     res = filecmp.cmp(files[itm], files[itm+2]) 
     comparisons[str(files[itm]) + ' vs ' + str(files[itm+2])] = res 
    except: 
     pass 
    try: 
     res = filecmp.cmp(files[itm], files[itm+3]) 
     comparisons[str(files[itm]) + ' vs ' + str(files[itm+3])] = res 
    except: 
     pass 
    try: 
     res = filecmp.cmp(files[itm], files[itm+4]) 
     comparisons[str(files[itm]) + ' vs ' + str(files[itm+4])] = res 
    except: 
     pass 
print(comparisons) 

給出：

{'F1.txt vs F2.txt': True, 'F1.txt vs F5.txt': False, 'F2.txt vs F4.txt': True, 
'F3.txt vs F4.txt': False, 'F1.txt vs F4.txt': True, 'F2.txt vs F3.txt': False, 
'F2.txt vs F5.txt': False, 'F1.txt vs F3.txt': False, 'F3.txt vs F5.txt': False, 
'F4.txt vs F5.txt': False} 

至於你的問題的另一部分，你可以使用內置的shutil和os模塊，像這樣：

import shutil 
import os 
if filecmp.cmp('F1.txt', 'F2.txt') is True: 
    shutil.move(os.path.abspath('F1.txt'), 'C:\\example\\path') 
    shutil.move(os.path.abspath('F2.txt'), 'C:\\example\\path') 

更新：更好的答案，從@修改zalew的回答：https://stackoverflow.com/a/748879/5247482

import shutil 
import os 
import hashlib 
def remove_duplicates(dir): 
    unique = [] 
    for filename in os.listdir(dir): 
     if os.path.isfile(dir+'\\'+filename): 
      print('--Checking ' + dir+'\\'+filename) 
      filehash = hashlib.md5(filename.encode('utf8')).hexdigest() 
      print(filename, ' has hash: ', filehash) 
      if filehash not in unique: 
       unique.append(filehash) 
      else: 
       shutil.move(os.path.abspath(filename), 'C:\\example\\path\\destinationfolder') 
    return 
remove_duplicates('C:\\example\\path\\sourcefolder')