2017-02-21 50 views
0
我有麻煩數據添加到列表中,我通過迭代

如下:嵌套的同級For循環,輸出列出

import urllib 
import urllib.request 
from bs4 import BeautifulSoup 
import pandas 

def make_soup(url): 
    thepage = urllib.request.urlopen(url) 
    thepage.addheaders = [('User-Agent', 'Mozilla/5.0')] 
    soupdata = BeautifulSoup(thepage, 'html.parser') 
    return soupdata 

soup = make_soup('https://www.wellstar.org/locations/pages/default.aspx') 

locationdata = [] 

for table in soup.findAll('table', class_ = 's4-wpTopTable'): 
    for name in table.findAll('div', 'PurpleBackgroundHeading'): 
     name = name.get_text(strip = True) 
    for loc_type in table.findAll('h3', class_ = 'WebFont SpotBodyGreen'): 
     loc_type = loc_type.get_text() 
    for address in table.findAll('div', class_ = ['WS_Location_Address', 'WS_Location_Adddress']): 
     address = address.get_text(strip = True, separator = ' ') 
     locationdata.append([name, loc_type, address]) 

df = pandas.DataFrame(columns = ['name', 'loc_type', 'address'], data = locationdata) 
print(df) 

產生的數據幀包括所有唯一的地址,但只有最後可能文字對應於name

例如,即使'WellStar Windy Hill醫院'是醫院類別/類型中的最後一家醫院,它顯示爲所有醫院的名稱。如果可能,我更喜歡list.append解決方案,因爲我有幾個類似的步驟來完成此項目。

回答

1

發生這種情況的原因是,您正在循環搜索所有名稱和loc_types ,然後被追加到locationdata

可以代替做:

import itertools as it 
from pprint import pprint as pp 

for table in soup.findAll('table', class_='s4-wpTopTable'): 
    names = [name.get_text(strip=True) for 
      name in table.findAll('div', 'PurpleBackgroundHeading')] 
    loc_types = [loc_type.get_text() for 
       loc_type in table.findAll('h3', class_='WebFont SpotBodyGreen')] 
    addresses = [address.get_text(strip=True, separator=' ') for 
       address in table.findAll('div', class_=['WS_Location_Address', 
                 'WS_Location_Adddress'])] 

for name, loc_type, address in it.izip_longest(names,loc_types,addresses): 
    locationdata.append([name, loc_type, address]) 

結果:

>>> pp.pprint(locationdata) 
[[u'WellStar Urgent Care in Acworth', 
    u'WellStar Urgent Care Centers', 
    u'4550 Cobb Parkway NW Suite 101 Acworth, GA 30101 770-917-8140'], 
[u'WellStar Urgent Care in Kennesaw', 
    None, 
    u'3805 Cherokee Street Kennesaw, GA 30144 770-426-5665'], 
[u'WellStar Urgent Care in Marietta - Delk Road', 
    None, 
    u'2890 Delk Road Marietta, GA 30067 770-955-8620'], 
[u'WellStar Urgent Care in Marietta - East Cobb', 
    None, 
    u'3747 Roswell Road Ne Suite 107 Marietta, GA 30062 470-956-0150'], 
[u'WellStar Urgent Care in Marietta - Kennestone', 
    None, 
    u'818 Church Street Suite 100 Marietta, GA 30060 770-590-4190'], 
[u'WellStar Urgent Care in Marietta - Sandy Plains Road', 
    None, 
    u'3600 Sandy Plains Road Marietta, GA 30066 770-977-4547'], 
[u'WellStar Urgent Care in Smyrna', 
    None, 
    u'4480 North Cooper Lake Road SE Suite 100 Smryna, GA 30082 770-333-1300'], 
[u'WellStar Urgent Care in Woodstock', 
    None, 
    u'120 Stonebridge Parkway Suite 310 Woodstock, GA 30189 678-494-2500']] 
+0

我覺得這是親密,但是,理想的結果應當包括對每個位置的地址組合loc_type。我們如何能夠將每條記錄的信息包含在內? – Daniel

+0

我給出了將數據放入列表的步驟,但您必須確保從數據頁中提取正確的數據。 – bernie