BeautifulSoup.find_all沒有檢索網頁的元素

我使用BeautifulSoup從隨機網站提取數據。我試圖找到類名爲simpleList的所有div標籤。但數據沒有被收集。它只是顯示一個空的列表。BeautifulSoup.find_all沒有檢索網頁的元素

   
 
     </div> 
 
     <div class="clear"></div> 
 
     <div id="locationSearchResults" class="simpleList"> 
 
       
 
       
 
       <div class="result "> 
 
        <span class="cell cellBorder normalWidth" onclick="document.location='/real-estate/rock-spring-ga/LCGAROCKSPRING/';"> 
 
        <a onclick="Track.doEvent('Location Search Results', 'Select Listings', 'Rock Spring, GA');" tabindex="2" title="Listings in Rock Spring, GA" class="suggestCollapse" href="/real-estate/rock-spring-ga/LCGAROCKSPRING/"><b>Rock Spring, GA</b></a> 
 
        </span> 
 
        
 
        
 
        <span class="cell cellBorder normalWidth"><a onclick="Track.doEvent('Location Search Results', 'Select Homes for Sale', 'Rock Spring, GA');" title="Homes for Sale in Rock Spring, GA" href="/real-estate/rock-spring-ga/LCGAROCKSPRING/">56 Listings</a></span> 
 
        
 
        
 
        
 
        
 
        
 
        <span class="cell cellBorder normalWidth disabled"><a onclick="return false;" title="Rentals in Rock Spring, GA" href="/real-estate/rock-spring-ga/LCGAROCKSPRING/?ty=3">0 Rentals</a></span> 
 
        
 
        
 
        
 
        
 
        <span class="cell cellBorder normalWidth disabled"><a onclick="return false;" title="Agents in Rock Spring, GA" href="/real-estate-agents/rock-spring-ga/LCGAROCKSPRING/">0 Agents</a></span>

import requests 
from bs4 import BeautifulSoup 
r=requests.get("http://www.century21.com/locationsearch.c21? 
q=Rock+Spring&v=0#r=10&l=Rock+Spring&c=1") 
c=r.content 
soup=BeautifulSoup(c,"html.parser") 
print(soup) 
all=soup.find_all("div",{"class":"simpleList"}) 
print(all)

會是什麼錯誤？

來源

2017-10-09 Akhil Reddy

問題是與你使用的HTML解析器。使用lxml或html5lib。

我用html5lib和它工作得很好：

all = soup.find('div', {'class': 'simpleList'}).findAll('div') 
print(len(all))

它給了我12

編輯：

下表總結了每個解析庫的優點和缺點：

來源：https://www.crummy.com/software/BeautifulSoup/bs4/doc/

來源

2017-10-09 11:19:30 Mahesh

試試這個：

from bs4 import BeautifulSoup 
from urllib.request import urlopen 

html = urlopen("http://your_site.com") 
soup = BeautifulSoup(html, 'lxml) 
all = soup.find_all('div', {'class': 'simpleList'}) 
print(all)

來源

2017-10-09 11:19:00 komito

BeautifulSoup.find_all沒有檢索網頁的元素

回答

相關問題