標籤裏面的beautifulsoup無法正常工作

Question

此代碼不打印公司名單作爲reqiured。 它沒有達到第一個標籤內 如果我在第一個標籤內寫入「print'文字'」，它不會打印它。 BeautifulSoup正在爲不同的網站編寫不同的代碼。 任何建議爲什麼它不起作用？

from bs4 import BeautifulSoup 
import urllib 
request = urllib.urlopen('http://www.stockmarketsreview.com/companies_sp500/') 
html = request.read() 
request.close() 
soup = BeautifulSoup(html) 
for tags in soup.find_all('div', {'class':'mainContent'}): 
    for row in tags.find_all('tr'): 
     for column in row.find_all('td'): 
      print column.text 

Answer 1

我BeautifulSoup 3，這似乎正常工作：

import BeautifulSoup as BS 
import urllib 
request = urllib.urlopen('http://www.stockmarketsreview.com/companies_sp500/') 
html = request.read() 
request.close() 
soup = BS.BeautifulSoup(html) 

try: 
    tags = soup.findAll('div', attrs={'class':'mainContent'}) 
    print '# tags = ' + str(len(tags)) 
    for tag in tags: 
     try:   
     tables = tag.findAll('table') 
     print '# tables = ' + str(len(tables)) 
     for table in tables:    
      try: 
       rows = tag.findAll('tr') 
       for row in rows: 
        try: 
        columns = row.findAll('td') 
        for column in columns: 
         print column.text 
        except: 
        e = 1 
        # print 'Caught error getting td tag under ' + str(row) 
        # This is okay since some rows have <th>, not <td> 
      except: 
       print 'Caught error getting tr tag under ' + str(table) 
     except: 
     print 'Caught error getting table tag under ' + str(tag) 
except: 
    print 'Caught error getting div tag' 

我相信你需要更換 '的findAll' 與 'find_all'。

輸出看起來是這樣的：