HTMLStripCharFilter在自定義分析器的createComponent實現中不起作用

Question

我在自定義分析器實現的createComponents實現中使用了HTMLStripCharFilter，但HTML沒有從內容中剝離。請在代碼下方找到。

@Override 
    protected TokenStreamComponents createComponents(String fieldName) 
    { 
     StandardTokenizer source = new StandardTokenizer(); 
     source.setReader(mStripHTML ? new HTMLStripCharFilter(getReader()) : getReader()); 
     source.setMaxTokenLength(maxTokenLength); 
     TokenStream result = new StandardFilter(source); 
     result = new LowerCaseFilter(result); 
     return new TokenStreamComponents(source, result); 
    } 

Answer 1

你CharFilter不應該在你的createComponents方法來定義，它應該是在initReader：

@Override 
protected Reader initReader(String fieldName, Reader reader) { 
    return mStripHTML ? new HTMLStripCharFilter(reader) : reader; 
} 

@Override 
protected TokenStreamComponents createComponents(String fieldName) 
{ 
    StandardTokenizer source = new StandardTokenizer(); 
    source.setMaxTokenLength(maxTokenLength); 
    TokenStream result = new StandardFilter(source); 
    result = new LowerCaseFilter(result); 
    return new TokenStreamComponents(source, result); 
} 

Answer 2

我建議使用CustomAnalyzer代替：https://lucene.apache.org/core/6_0_1/analyzers-common/org/apache/lucene/analysis/custom/CustomAnalyzer.html

（它是可用自Lucene 5.x）