Python BeautifulSoup，遍歷標籤和屬性

Question

我想遍歷html頁面某些部分中的所有標籤。我申請了BeautifulSoup，但我可以沒有它，只是硒庫。 比方說，我有以下的html代碼：

<table id="myBSTable"> 
    <tr> 
     <th>Column A1</th> 
     <th>Column B1</th> 
     <th>Column C1</th> 
     <th>Column D1</th> 
     <th>Column E1</th> 
    </tr> 
    <tr> 
     <td data="First Column Data"></td> 
     <td data="Second Column Data"></td> 
     <td title="Title of the First Row">Value of Row 1</td> 
     <td>Beautiful 1</td> 
     <td>Soup 1</td> 
    </tr> 
    <tr> 
     <td></td> 
     <td data-g="Second Column Data"></td> 
     <td title="Title of the Second Row">Value of Row 2</td> 
     <td>Selenium 1</td> 
     <td>Rocks 1</td> 
    </tr> 
    <tr> 
     <td></td> 
     <td></td> 
     <td title="Title of the Third Row">Value of Row 3</td> 
     <td>Pyhon 1</td> 
     <td>Boulder 1</td> 
    </tr> 
    <tr> 
     <th>Column A2</th> 
     <th>Column B2</th> 
     <th>Column C2</th> 
     <th>Column D2</th> 
     <th>Column E2</th> 
    </tr> 
    <tr> 
     <td data="First Column Data"></td> 
     <td data="Second Column Data"></td> 
     <td title="Title of the First Row">Value of Row 1</td> 
     <td>Beautiful 2</td> 
     <td>Soup 2</td> 
    </tr> 
    <tr> 
     <td></td> 
     <td data-g="Second Column Data"></td> 
     <td title="Title of the Second Row">Value of Row 2</td> 
     <td>Selenium 2</td> 
     <td>Rocks 2</td> 
    </tr> 
    <tr> 
     <td></td> 
     <td></td> 
     <td title="Title of the Third Row">Value of Row 3 2</td> 
     <td>Pyhon 2</td> 
     <td>Boulder 2</td> 
    </tr> 
</table> 

我有這部分工作完美：

#Selenium libraries 
from selenium import webdriver 
from selenium.webdriver.common.keys import Keys 
from selenium.common.exceptions import NoSuchElementException 

#BeautifulSoup 
from bs4 import BeautifulSoup 

browser = webdriver.Firefox() 
browser.get('http://urltoget.com') 

table = browser.find_element_by_id('myBSTable') 
bs_table = BeautifulSoup(table.get_attribute('innerHTML'), 'lxml') 
#So far so good 
rows = bs_table.findAll('tr') 
for tr in rows: 
    #Here is where I need help 
    #I want to iterate through all tags 
    #but I don't know if is going to be a th or a td 
    #At the same time I need to do something 
    #if is a td or a th 

這是我想要完成的任務：

#The following is a pseudo code 
    for col in tr.tags: 
     print col.name, col.value 
     for attribute in col.attrs: 
      print " ", attribute.name, attribute.value 
    #End pseudo code 

謝謝， Arty

Answer 1

您可能會找到td或th，方法是指定要查找的標籤列表。爲了讓所有的元素屬性，使用.attrs attribute：

rows = bs_table.find_all('tr') 
for row in rows: 
    cells = row.find_all(['td', 'th']) 
    for cell in cells: 
     print(cell.name, cell.attrs) 

Answer 2

替代循環（動作是在底部）：

html='''<table id="myBSTable"> 
    <tr> 
     <th>Column A1</th> 
     <th>Column B1</th> 
     <th>Column C1</th> 
     <th>Column D1</th> 
     <th>Column E1</th> 
    </tr> 
    <tr> 
     <td data="First Column Data"></td> 
     <td data="Second Column Data"></td> 
     <td title="Title of the First Row">Value of Row 1</td> 
     <td>Beautiful 1</td> 
     <td>Soup 1</td> 
    </tr> 
    <tr> 
     <td></td> 
     <td data-g="Second Column Data"></td> 
     <td title="Title of the Second Row">Value of Row 2</td> 
     <td>Selenium 1</td> 
     <td>Rocks 1</td> 
    </tr> 
    <tr> 
     <td></td> 
     <td></td> 
     <td title="Title of the Third Row">Value of Row 3</td> 
     <td>Pyhon 1</td> 
     <td>Boulder 1</td> 
    </tr> 
    <tr> 
     <th>Column A2</th> 
     <th>Column B2</th> 
     <th>Column C2</th> 
     <th>Column D2</th> 
     <th>Column E2</th> 
    </tr> 
    <tr> 
     <td data="First Column Data"></td> 
     <td data="Second Column Data"></td> 
     <td title="Title of the First Row">Value of Row 1</td> 
     <td>Beautiful 2</td> 
     <td>Soup 2</td> 
    </tr> 
    <tr> 
     <td></td> 
     <td data-g="Second Column Data"></td> 
     <td title="Title of the Second Row">Value of Row 2</td> 
     <td>Selenium 2</td> 
     <td>Rocks 2</td> 
    </tr> 
    <tr> 
     <td></td> 
     <td></td> 
     <td title="Title of the Third Row">Value of Row 3 2</td> 
     <td>Pyhon 2</td> 
     <td>Boulder 2</td> 
    </tr> 
</table>''' 

Soup = BeautifulSoup(html) 

rows = Soup.findAll('tr') 
for tr in rows: 
    for z in tr.children: 
     if z.name =='td': 
      do stuff1 
     if z.name == 'th': 
      do stuff2