如何在文件請求中運行多個URL

Question

我試圖從txt文件中的URL中取消多個網站。每行有一個url。

我的代碼是：

Import requests 
from bs4 import BeautifulSoup 

file = open('url.txt', 'r') 
filelines = file.readline() 
urllist = requests.get(filelines) 
soup = BeautifulSoup(urllist.content, "html.parser") 
content = soup.find_all("span", {"class": "title-main-info"}) 
print content 

但它打印只有最後的URL內容（最後一行）。我做錯了什麼？ 謝謝

Answer 1

試試這個。它應該工作：

import requests 
from bs4 import BeautifulSoup 

with open('url.txt', 'r') as f: 
    for links in f.readlines(): 
     urllist= requests.get(links.strip()) 
     soup = BeautifulSoup(urllist.content, "html.parser") 
     content = soup.find_all("span", {"class": "title-main-info"}) 
     print content