2013-09-25 61 views
6

的名單我不是一個程序員,也是新的Python,我有類型的字典從JSON文件來的列表:的Python - 查找重複的字典並組

# JSON file (film.json) 
[{"year": ["1999"], "director": ["Wachowski"], "film": ["The Matrix"], "price": ["19,00"]}, 
{"year": ["1994"], "director": ["Tarantino"], "film": ["Pulp Fiction"], "price": ["20,00"]}, 
{"year": ["2003"], "director": ["Tarantino"], "film": ["Kill Bill vol.1"], "price": ["10,00"]}, 
{"year": ["2003"], "director": ["Wachowski"], "film": ["The Matrix Reloaded"], "price": ["9,99"]}, 
{"year": ["1994"], "director": ["Tarantino"], "film": ["Pulp Fyction"], "price": ["15,00"]}, 
{"year": ["1994"], "director": ["E. de Souza"], "film": ["Street Fighter"], "price": ["2,00"]}, 
{"year": ["1999"], "director": ["Wachowski"], "film": ["The Matrix"], "price": ["20,00"]}, 
{"year": ["1982"], "director": ["Ridley Scott"], "film": ["Blade Runner"], "price": ["19,99"]}] 

我可以導入JSON與文件:

import json 
json_file = open('film.json') 
f = json.load(json_file) 

但在那之後我不能找到出現在f和電影片名他們組分開。 這就是我要找的實現:

## result grouped by 'film' 
#group 1 
{"year": ["1999"], "director": ["Wachowski"], "film": ["The Matrix"], "price": ["19,00"]} 
{"year": ["1999"], "director": ["Wachowski"], "film": ["The Matrix"], "price": ["20,00"]} 
#group 2 
{"year": ["1994"], "director": ["Tarantino"], "film": ["Pulp Fiction"], "price": ["20,00"]} 
{"year": ["1994"], "director": ["Tarantino"], "film": ["Pulp Fyction"], "price": ["15,00"]} 
#group X 
... 

或者更好:

new_dict = { 'group1':[[],[],...] , 'group2':[[],[],...] , 'groupX':[...] } 

目前我與嵌套for但沒有運氣測試..

謝謝。

注:「紙漿fyction」是用模糊字符串匹配的將來實現通緝的錯誤,現在我只需要一個「重複石斑魚」

注2:與Python 2.x的

+0

你在分組什麼?單獨標題?標題+導演+年份? – wim

+0

http://docs.python.org/2/library/itertools.html#itertools.groupby – dm03514

+0

爲什麼不通過電影給你的小組命名? –

回答

8

因爲你的數據未排序,使用collections.defaultdict() object兌現列表爲新的密鑰,然後通過膜標題密鑰:

from collections import defaultdict 

grouped = defaultdict(list) 

for film in f: 
    grouped[film['film'][0]].append(film) 

film['film'][0]值用於組的膜。如果您想使用更復雜的標題分組,則必須創建該鍵的標準版本。

演示:

>>> from collections import defaultdict 
>>> import json 
>>> with open('film.json') as film_file: 
...  f = json.load(film_file) 
... 
>>> grouped = defaultdict(list) 
>>> for film in f: 
...  grouped[film['film'][0]].append(film) 
... 
>>> grouped 
defaultdict(<type 'list'>, {u'Street Fighter': [{u'director': [u'E. de Souza'], u'price': [u'2,00'], u'film': [u'Street Fighter'], u'year': [u'1994']}], u'Pulp Fiction': [{u'director': [u'Tarantino'], u'price': [u'20,00'], u'film': [u'Pulp Fiction'], u'year': [u'1994']}], u'Pulp Fyction': [{u'director': [u'Tarantino'], u'price': [u'15,00'], u'film': [u'Pulp Fyction'], u'year': [u'1994']}], u'The Matrix': [{u'director': [u'Wachowski'], u'price': [u'19,00'], u'film': [u'The Matrix'], u'year': [u'1999']}, {u'director': [u'Wachowski'], u'price': [u'20,00'], u'film': [u'The Matrix'], u'year': [u'1999']}], u'Blade Runner': [{u'director': [u'Ridley Scott'], u'price': [u'19,99'], u'film': [u'Blade Runner'], u'year': [u'1982']}], u'Kill Bill vol.1': [{u'director': [u'Tarantino'], u'price': [u'10,00'], u'film': [u'Kill Bill vol.1'], u'year': [u'2003']}], u'The Matrix Reloaded': [{u'director': [u'Wachowski'], u'price': [u'9,99'], u'film': [u'The Matrix Reloaded'], u'year': [u'2003']}]}) 
>>> from pprint import pprint 
>>> pprint(dict(grouped)) 
{u'Blade Runner': [{u'director': [u'Ridley Scott'], 
        u'film': [u'Blade Runner'], 
        u'price': [u'19,99'], 
        u'year': [u'1982']}], 
u'Kill Bill vol.1': [{u'director': [u'Tarantino'], 
         u'film': [u'Kill Bill vol.1'], 
         u'price': [u'10,00'], 
         u'year': [u'2003']}], 
u'Pulp Fiction': [{u'director': [u'Tarantino'], 
        u'film': [u'Pulp Fiction'], 
        u'price': [u'20,00'], 
        u'year': [u'1994']}], 
u'Pulp Fyction': [{u'director': [u'Tarantino'], 
        u'film': [u'Pulp Fyction'], 
        u'price': [u'15,00'], 
        u'year': [u'1994']}], 
u'Street Fighter': [{u'director': [u'E. de Souza'], 
         u'film': [u'Street Fighter'], 
         u'price': [u'2,00'], 
         u'year': [u'1994']}], 
u'The Matrix': [{u'director': [u'Wachowski'], 
        u'film': [u'The Matrix'], 
        u'price': [u'19,00'], 
        u'year': [u'1999']}, 
       {u'director': [u'Wachowski'], 
        u'film': [u'The Matrix'], 
        u'price': [u'20,00'], 
        u'year': [u'1999']}], 
u'The Matrix Reloaded': [{u'director': [u'Wachowski'], 
          u'film': [u'The Matrix Reloaded'], 
          u'price': [u'9,99'], 
          u'year': [u'2003']}]} 

使用如SoundEx到基膜將是簡單的:

from itertools import groupby, islice, ifilter 

_codes = ('bfpv', 'cgjkqsxz', 'dt', 'l', 'mn', 'r') 
_sounds = {c: str(i) for i, code in enumerate(_codes, 1) for c in code} 
_sounds.update(dict.fromkeys('aeiouy')) 
def soundex(word, _sounds=_sounds): 
    grouped = groupby(_sounds[c] for c in word.lower() if c in _sounds) 
    if _sounds.get(word[0].lower()): 
     next(grouped) # remove first group. 
    sdx = ''.join([k for k, g in islice((g for g in grouped if g[0]), 3)]) 
    return word[0].upper() + format(sdx, '<03') 

grouped_by_soundex = defaultdict(list) 
for film in f: 
    grouped_by_soundex[soundex(film['film'][0])].append(film) 

導致:

>>> pprint(dict(grouped_by_soundex)) 
{u'B436': [{u'director': [u'Ridley Scott'], 
      u'film': [u'Blade Runner'], 
      u'price': [u'19,99'], 
      u'year': [u'1982']}], 
u'K414': [{u'director': [u'Tarantino'], 
      u'film': [u'Kill Bill vol.1'], 
      u'price': [u'10,00'], 
      u'year': [u'2003']}], 
u'P412': [{u'director': [u'Tarantino'], 
      u'film': [u'Pulp Fiction'], 
      u'price': [u'20,00'], 
      u'year': [u'1994']}, 
      {u'director': [u'Tarantino'], 
      u'film': [u'Pulp Fyction'], 
      u'price': [u'15,00'], 
      u'year': [u'1994']}], 
u'S363': [{u'director': [u'E. de Souza'], 
      u'film': [u'Street Fighter'], 
      u'price': [u'2,00'], 
      u'year': [u'1994']}], 
u'T536': [{u'director': [u'Wachowski'], 
      u'film': [u'The Matrix'], 
      u'price': [u'19,00'], 
      u'year': [u'1999']}, 
      {u'director': [u'Wachowski'], 
      u'film': [u'The Matrix Reloaded'], 
      u'price': [u'9,99'], 
      u'year': [u'2003']}, 
      {u'director': [u'Wachowski'], 
      u'film': [u'The Matrix'], 
      u'price': [u'20,00'], 
      u'year': [u'1999']}]} 
0

如果它是一次性的,我很匆忙我會這樣做。假設在這個例子中,你的字典的名單LOD,而且片頭將永遠只能是一個項目的列表

new_dict = {k:[d for d in lod if d.get('film')[0] == k] for k in set(d.get('film')[0] for d in l)} 

爲了使其更具可讀性,並說明它是做什麼的,同樣的事情打破再次,詞典的列表是lod:

#get all the unique film names 
# note: the [0] is because its a list for the title, and set doesn't work with lists, 
#so we're just taking the first one for this example. 
films = set(d.get('film')[0] for d in lod) 


#create a dictionary 
new_dict = {} 

#iterate over the unique film names 
for k in films: 
    #make a list of all the films that match the name we're on 
    filmswiththisname = [d for d in lod if d.get('film')[0] == k] 
    #add the list of films to the new dictionary with the film name as the key. 
    new_dict[k] = filmswiththisname