get_text（）有UnicodeEncodeError

Question

我有以下HTML：

<div class="dialog"> 
<div class="title title-with-sort-row"> 
    <h2>Description</h2> 
    <div class="dialog-search-sort-bar"> 
    </div> 
</div> 
<div class="content"><div style="margin-right: 20px; margin-left: 30px;"> 
    <span class="description2"> 
     With 「Antonia Polygon – Standard」, you have a figure that is unique in the Poser community. 
     She is made available under a Creative Commons License that gives endless opportunities for further development. 
     This figure was developed by a group of talented members of the Poser community in a thirty-month effort. 
     The result is a figure that has very good bending and morphing behavior. 
     <br /> 
    </span> 
</div> 
</div> 

我需要找到這個div出class="dialog"數的div，然後拉出在span class="description2"文本。

當我使用的代碼：

description = soup.find(text = re.compile('Description')) 
if description != None: 
    someEl = description.parent 
    parent1 = someEl.parent 
    parent2 = parent1.parent 
    description = parent2.find('span', {'class' : 'description2'}) 
    print 'Description: ' + str(description) 

我得到：

<span class="description2"> 
    With Â「Antonia Polygon – StandardÂ」, you have a figure that is unique in the Poser community. 
    She is made available under a Creative Commons License that gives endless opportunities for further development. 
    This figure was developed by a group of talented members of the Poser community in a thirty-month effort. 
    The result is a figure that has very good bending and morphing behavior. 
    <br/> 
</span> 

如果我試圖讓只是文本，而HTML &非ASCII字符，使用

description = description.get_text() 

我收到一個(UnicodeEncodeError): 'ascii' codex can't encode character u'\x93'

如何將這個HTML塊轉換爲直線ascii？

Answer 1

#!/usr/bin/env python 
# -*- coding: utf-8 -*- 

foo = u'With Â「Antonia Polygon – StandardÂ」, you have a figure that is unique in the Poser community.She is made available under a Creative Commons License that gives endless opportunities for further development. This figure was developed by a group of talented members of the Poser community in a thirty-month effort. The result is a figure that has very good bending and morphing behavior.' 

print foo.encode('ascii', 'ignore') 

有三件事要注意。

首先是'ignore'參數的編碼方法。它指示方法刪除不在所選編碼範圍內的字符（在這種情況下，ascii爲安全）。

其次是我們明確地將foo設置爲unicode，方法是在字符串前加上u。

三是顯式文件編碼指令：# -*- coding: utf8 -*-。

另外，如果你在閱讀這個答案時沒有閱讀Daenyth的評論，那麼你就是一個愚蠢的人。如果要在HTML/XML中使用輸出，則可以使用xmlcharrefreplace代替上面的ignore，以取得很好的公正性。