urllib2.HTTPError：在網頁上劃掉一個巨大的列表

Question

網頁上有一個包含其他詳細信息的日記名稱的巨大列表。我試圖將表格內容拖放到數據框中。

#http://www.citefactor.org/journal-impact-factor-list-2015.html 

import bs4 as bs 
import urllib #Using python 2.7 
import pandas as pd 

dfs = pd.read_html('http://www.citefactor.org/journal-impact-factor-list-2015.html/', header=0) 
for df in dfs: 
    print(df) 
    df.to_csv('citefactor_list.csv', header=True) 

但我得到以下錯誤..我曾嘗試引用一些已提出的問題，但無法修復。

錯誤：

Traceback (most recent call last): 
    File "scrape_impact_factor.py", line 7, in <module> 
    dfs = pd.read_html('http://www.citefactor.org/journal-impact-factor-list-2015.html/', header=0) 
    File "/usr/local/lib/python2.7/dist-packages/pandas/io/html.py", line 896, in read_html 
    keep_default_na=keep_default_na) 
    File "/usr/local/lib/python2.7/dist-packages/pandas/io/html.py", line 733, in _parse 
    raise_with_traceback(retained) 
    File "/usr/local/lib/python2.7/dist-packages/pandas/io/html.py", line 727, in _parse 
    tables = p.parse_tables() 
    File "/usr/local/lib/python2.7/dist-packages/pandas/io/html.py", line 196, in parse_tables 
    tables = self._parse_tables(self._build_doc(), self.match, self.attrs) 
    File "/usr/local/lib/python2.7/dist-packages/pandas/io/html.py", line 450, in _build_doc 
    return BeautifulSoup(self._setup_build_doc(), features='html5lib', 
    File "/usr/local/lib/python2.7/dist-packages/pandas/io/html.py", line 443, in _setup_build_doc 
    raw_text = _read(self.io) 
    File "/usr/local/lib/python2.7/dist-packages/pandas/io/html.py", line 130, in _read 
    with urlopen(obj) as url: 
    File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ 
    return self.gen.next() 
    File "/usr/local/lib/python2.7/dist-packages/pandas/io/common.py", line 60, in urlopen 
    with closing(_urlopen(*args, **kwargs)) as f: 
    File "/usr/lib/python2.7/urllib2.py", line 127, in urlopen 
    return _opener.open(url, data, timeout) 
    File "/usr/lib/python2.7/urllib2.py", line 410, in open 
    response = meth(req, response) 
    File "/usr/lib/python2.7/urllib2.py", line 523, in http_response 
    'http', request, response, code, msg, hdrs) 
    File "/usr/lib/python2.7/urllib2.py", line 448, in error 
    return self._call_chain(*args) 
    File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain 
    result = func(*args) 
    File "/usr/lib/python2.7/urllib2.py", line 531, in http_error_default 
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) 
urllib2.HTTPError: HTTP Error 500: Internal Server Error 

Answer 1

500內部服務器錯誤意味着發生了錯誤的服務器上，因此你無法控制的。

但問題是您使用的URL錯誤。

如果你在你的瀏覽器中訪問http://www.citefactor.org/journal-impact-factor-list-2015.html/你會得到一個404找不到的錯誤。刪除斜槓即http://www.citefactor.org/journal-impact-factor-list-2015.html，它會起作用。