BeautifulSoup Absoute URLs Print to CSV

Question

我在這裏經歷了大量的線程，看看我能否找到一種方法來修復此代碼，但似乎無法讓這個工作。我試圖從網站上獲取鏈接，然後寫入csv。下面的代碼：

我找到一種方式來獲得的方式出現95％，但我缺少的東西想起來在href：

from bs4 import BeautifulSoup 
    import urllib.request 
    import urllib.parse 
    import csv 

    j = urllib.request.urlopen("http://cnn.com") 
    soup = BeautifulSoup(j, "lxml") 
    data = soup.find_all('a', href=True) 

    for url in soup.find_all('a', href=True): 
#print(url.get('href')) 

     with open('marcel.csv', 'w', newline='') as csvfile: 
      write = csv.writer(csvfile) 
      write.writerows(data) 

Answer 1

這可能是你想要做什麼。

from bs4 import BeautifulSoup 
import requests #better than urllib 
import csv 

j = requests.get("http://cnn.com").content 
soup = BeautifulSoup(j, "lxml") 

data = [] 
for url in soup.find_all('a', href=True): 
    print(url['href']) 
    data.append(url['href']) 

print(data) 

with open("marcel.csv",'w') as csvfile: 
    write = csv.writer(csvfile, delimiter = ' ') 
    write.writerows(data) 

Answer 2

我用openpyxl得到它

from openpyxl import Workbook,load_workbook 

我覺得這很容易。 這是我的項目的一部分，你可以試試

def createExcel(self): 
     wb = Workbook(optimized_write=True) 
     ws = wb.create_sheet(title='書籍列表') 
     row0 = ['編號','條碼號','題名','責任者','借閱日期','歸還日期','館藏地'] 
     ws.append(row0) 
     save_path = 'book_hist.xlsx' 
     wb.save(save_path) 

    def saveToExcel(self,data_list): 
     wb = load_workbook(filename='book_hist.xlsx') 
     ws = wb.get_sheet_by_name('書籍列表') 
     for i in range(len(data_list)): 
      ws.append(data_list[i]) 
     save_path = 'book_hist.xlsx' 
     wb.save(save_path)