2016-02-28 90 views
2

當我試圖通過此代碼達到圖像標記時,我得到以下輸出。如何從鏈接獲取圖片?

url = 'https://paytm.com/shop/p/pepe-jeans-blue-slim-fit-t-shirts-APPPEPE-JEANS-BSETU2010438B648267' 

def soup_maker(url): 
    r = requests.get(url) 
    markup = r.content 
    soup = bs(markup, "html.parser") 
    return soup 

def get_images(url): 
    soup = soup_maker(url) 
    divs = soup.find_all('div', {'class': 'fixed-height'}) 
    print(divs) 
    images = soup.find_all('img') 
    print(images) 

輸出

[] 
[<img alt="{{::product.text}}" ng-src="{{::product.image_url}}"/>, 
<img alt="{{item.title}}" ng-src='{{cart.imgResized(item.image_url,"50x50") }}'/>, 
<img ng-src="{{pixelSource}}"/>] 

但是,當我看到通過檢查元素的存在。我不知道如何保存這些圖像。

UPDATE

from selenium import webdriver 
from selenium.webdriver.common.by import By 
from selenium.webdriver.support.ui import WebDriverWait 
from selenium.webdriver.support import expected_conditions as EC 

def soup_maker(url): 
    driver = webdriver.Chrome() 
    driver.get(url) 
    try: 
     element = WebDriverWait(driver, 20).until(
     EC.presence_of_element_located((By.CLASS_NAME, "fixed-height")) 
     ) 
     markup = driver.page_source 
     soup = bs(markup, "html.parser") 
     return soup 
    finally: 
     driver.quit() 
    driver.close() 

以上爲我工作。

回答

2

這看起來像定義綁定的AngularJS模板,這意味着該網站需要一個真正的瀏覽器使用JavaScript引擎中被渲染讓我們離開解析一部分是,但不是requests,通過selenium獲取源:

from selenium import webdriver 

def soup_maker(url): 
    driver = webdriver.Firefox() # could also be Chrome(), PhantomJS() or other 
    driver.get(url) 

    # you might also need an Explicit Wait here to wait for the page to load 
    # see http://selenium-python.readthedocs.org/waits.html#explicit-waits 

    markup = driver.page_source 
    driver.close() 
    soup = bs(markup, "html.parser") 
    return soup