Python BeautifulSoup以CSV格式打印信息

Question

我可以打印出我從網站上提取的信息，沒有任何問題。但是，當我嘗試將街道名稱放在一列中，並將郵編放入另一列中時，我就會遇到遇到問題時的CSV文件。我所獲得的所有CSV都是兩列名稱，並且每一頁都在頁面的各列中。這是我的代碼。另外我使用Python 2.7.5和美麗的湯4

from bs4 import BeautifulSoup 
import csv 
import urllib2 

url="http://www.conakat.com/states/ohio/cities/defiance/road_maps/" 

page=urllib2.urlopen(url) 

soup = BeautifulSoup(page.read()) 

f = csv.writer(open("Defiance Steets1.csv", "w")) 
f.writerow(["Name", "ZipCodes"]) # Write column headers as the first line 

links = soup.find_all(['i','a']) 

for link in links: 
    names = link.contents[0] 
    print unicode(names) 

f.writerow(names) 

Answer 1

您從URL檢索數據包含比i元素更a元素。您必須過濾a元素，然後使用Python zip buildin構建對。

links = soup.find_all('a') 
links = [link for link in links 
     if link["href"].startswith("http://www.conakat.com/map/?p=")] 
zips = soup.find_all('i') 

for l, z in zip(links, zips): 
    f.writerow((l.contents[0], z.contents[0])) 

輸出：

Name,ZipCodes 
1ST ST,(43512) 
E 1ST ST,(43512) 
W 1ST ST,(43512) 
2ND ST,(43512) 
E 2ND ST,(43512) 
W 2ND ST,(43512) 
3 RIVERS CT,(43512) 
3RD ST,(43512) 
E 3RD ST,(43512) 
... 

Answer 2

另一種方法（python3）是每一個<a>鏈接後，找到下一個兄弟，檢查它是否是一個標籤，並提取其價值：

from bs4 import BeautifulSoup 
import csv 
import urllib.request as urllib2 

url="http://www.conakat.com/states/ohio/cities/defiance/road_maps/" 

page=urllib2.urlopen(url) 

soup = BeautifulSoup(page.read()) 

f = csv.writer(open("Defiance Steets1.csv", "w")) 
f.writerow(["Name", "ZipCodes"]) # Write column headers as the first line 

links = soup.find_all('a') 

for link in links: 
    i = link.find_next_sibling('i') 
    if getattr(i, 'name', None): 
     a, i = link.string, i.string 
     f.writerow([a, i]) 

它產生：

Name,ZipCodes 
1ST ST,(43512) 
E 1ST ST,(43512) 
W 1ST ST,(43512) 
2ND ST,(43512) 
E 2ND ST,(43512) 
W 2ND ST,(43512) 
3 RIVERS CT,(43512) 
3RD ST,(43512) 
E 3RD ST,(43512) 
W 3RD ST,(43512) 
...