如何獲得python beautifulsoup中的下一頁鏈接？

Question

我有此鏈接：

http://www.brothersoft.com/windows/categories.html 

我想獲得的鏈接DIV中的項目。 例子：

http://www.brothersoft.com/windows/mp3_audio/midi_tools/ 

我曾嘗試這樣的代碼：

import urllib 
from bs4 import BeautifulSoup 

url = 'http://www.brothersoft.com/windows/categories.html' 

pageHtml = urllib.urlopen(url).read() 

soup = BeautifulSoup(pageHtml) 

sAll = [div.find('a') for div in soup.findAll('div', attrs={'class':'brLeft'})] 

for i in sAll: 
    print "http://www.brothersoft.com"+i['href'] 

但我只得到輸出：

http://www.brothersoft.com/windows/mp3_audio/ 

我怎樣才能得到我需要的輸出？

Answer 1

Url http://www.brothersoft.com/windows/mp3_audio/midi_tools/不在標記<div class='brLeft'>中，所以如果輸出是http://www.brothersoft.com/windows/mp3_audio/，那是正確的。

如果你想獲得你想要的網址，改變

sAll = [div.find('a') for div in soup.findAll('div', attrs={'class':'brLeft'})] 

到

sAll = [div.find('a') for div in soup.findAll('div', attrs={'class':'brRight'})] 

UPDATE：

一個例子來獲得內部消息 'midi_tools'

import urllib 
from bs4 import BeautifulSoup 

url = 'http://www.brothersoft.com/windows/categories.html' 
pageHtml = urllib.urlopen(url).read() 
soup = BeautifulSoup(pageHtml) 
sAll = [div.find('a') for div in soup.findAll('div', attrs={'class':'brRight'})] 
for i in sAll: 
    suburl = "http://www.brothersoft.com"+i['href'] #which is a url like 'midi_tools' 

    content = urllib.urlopen(suburl).read() 
    anosoup = BeautifulSoup(content) 
    ablock = anosoup.find('table',{'id':'courseTab'}) 
    for atr in ablock.findAll('tr',{'class':'border_bot '}): 
     print atr.find('dt').a.string  #name 
     print "http://www.brothersoft.com" + atr.find('a',{'class':'tabDownload'})['href'] #link