如何使用硒

Question

我試圖用硒和Python來打印一些信息，但它打印不是所有的CSS的路徑，這是while循環怎麼會只是一個信息打印信息..

pageIndex = 1 
while True: # Keep looping through all pages 
    # Navigate to the search page 
    browser.get("https://www.houz.com/page_num="+ str(pageIndex)) 
    time.sleep(6) 

    links = browser.find_elements_by_css_selector('div > h3 > a') 
    for link in links: 
     urls = link.text 


    jobs = browser.find_elements_by_css_selector('div > div.description') 
    for title in jobs: 
     jobtitles = title.text 


    with open("1Exportdata.csv", "a") as csvFile: 
     csvFile.write(url + "," + jobtitle + "\n") 

    pageIndex += 1 
    if pageIndex == 5010: 
     browser.close() 

Answer 1

因爲你使用：

for title in jobs: 
    jobtitles = title.text 

在第一循環中，jobtitles是第一title.text，但隨後，在第二循環中，它成爲第二個title.text。最後它會成爲最後的title.text。

例如：

>>> for i in [1, 2, 3]: 
...  num = i 
>>> print(num) 
3 
>>> 

所以你需要寫with open("1Exportdata.csv", "a") as csvFile:的for循環中。因爲你有兩個名單，我建議你使用zip類壓縮他們：

pageIndex = 1 
while True: # Keep looping through all pages 
    # Navigate to the search page 
    browser.get("https://www.houz.com/page_num="+ str(pageIndex)) 
    time.sleep(6) 

    links = browser.find_elements_by_css_selector('div > h3 > a') 
    jobs = browser.find_elements_by_css_selector('div > div.description') 

    for link, title in zip(links, jobs): 
     url = link.text 
     jobtitle = title.text 


     with open("1Exportdata.csv", "a") as csvFile: 
      csvFile.write(url + "," + jobtitle + "\n") 

    pageIndex += 1 
    if pageIndex == 5010: 
     browser.close() 

---

而且我認爲使用while循環是沒用的，儘量使用for循環，而不是：

for pageIndex in range(1, 5011): 
    # Navigate to the search page 
    browser.get("https://www.houz.com/page_num="+ str(pageIndex)) 
    time.sleep(6) 

    links = browser.find_elements_by_css_selector('div > h3 > a') 
    jobs = browser.find_elements_by_css_selector('div > div.description') 

    for link, title in zip(links, jobs): 
     url = link.text 
     jobtitle = title.text 


     with open("1Exportdata.csv", "a") as csvFile: 
      csvFile.write(url + "," + jobtitle + "\n")