與點

Question

字母值Elasticsearch分析令牌我有一個文本字段已經當我檢查使用分析API（默認分析）這個值 -

term1-term2-term3-term4-term5-RWHPSA951000155.2013-05-27.log 

，我得到這個 -

{ 
    "tokens": [ 
     { 
      "token": "text", 
      "start_offset": 2, 
      "end_offset": 6, 
      "type": "<ALPHANUM>", 
      "position": 1 
     }, 
     { 
      "token": "term1", 
      "start_offset": 9, 
      "end_offset": 14, 
      "type": "<ALPHANUM>", 
      "position": 2 
     }, 
     { 
      "token": "term2", 
      "start_offset": 15, 
      "end_offset": 20, 
      "type": "<ALPHANUM>", 
      "position": 3 
     }, 
     { 
      "token": "term3", 
      "start_offset": 21, 
      "end_offset": 26, 
      "type": "<ALPHANUM>", 
      "position": 4 
     }, 
     { 
      "token": "term4", 
      "start_offset": 27, 
      "end_offset": 32, 
      "type": "<ALPHANUM>", 
      "position": 5 
     }, 
     { 
      "token": "term5", 
      "start_offset": 33, 
      "end_offset": 38, 
      "type": "<ALPHANUM>", 
      "position": 6 
     }, 
     { 
      "token": "rwhpsa951000155.2013", 
      "start_offset": 39, 
      "end_offset": 59, 
      "type": "<ALPHANUM>", 
      "position": 7 
     }, 
     { 
      "token": "05", 
      "start_offset": 60, 
      "end_offset": 62, 
      "type": "<NUM>", 
      "position": 8 
     }, 
     { 
      "token": "27", 
      "start_offset": 63, 
      "end_offset": 65, 
      "type": "<NUM>", 
      "position": 9 
     }, 
     { 
      "token": "log", 
      "start_offset": 66, 
      "end_offset": 69, 
      "type": "<ALPHANUM>", 
      "position": 10 
     } 
    ] 
} 

我特別好奇這個令牌 - rwhpsa951000155.2013。這是怎麼發生的？目前我的搜索匹配RWHPSA951000155因此失敗。我如何才能將它識別爲單獨的令牌RWHPSA951000155和2013？

請注意，如果值爲term1-term2-term3-term4-term5-RWHPSA.2013-05-27.log，那麼它會將和2013拆分爲單獨的標記。所以這與951000155有關。

謝謝，

Answer 1

的Standard Analyzer被標記化rwhpsa951000155.2013作爲產品數量。在連字符

拆分詞語，除非有一個號碼在令牌，在 這種情況下，整個令牌被解釋爲一個產品編號和是 不分裂。

您可以添加模式分析器來替換'。'與一個空白空間。默認的分析器會按照你想要的方式標記這個術語。

/POST test 
{ 
    "settings": { 
     "index": { 
      "analysis": { 
       "char_filter": { 
        "my_pattern": { 
         "type": "pattern_replace", 
         "pattern": "\\.", 
         "replacement": " " 
        } 
       }, 
       "analyzer": { 
        "my_analyzer": { 
         "tokenizer": "standard", 
         "char_filter": [ 
          "my_pattern" 
         ] 
        } 
       } 
      } 
     } 
    }, 
    "mappings": { 
     "my_type": { 
      "properties": { 
       "test": { 
        "type": "string", 
        "analyzer": "my_analyzer" 
       } 
      } 
     } 
    } 
} 

調用API分析：

curl -XGET 'localhost:9200/test/_analyze?analyzer=my_analyzer&pretty=true' -d 'term1-term2-term3-term4-term5-RWHPSA.2013-05-27.log' 

返回：

{ 
    "tokens" : [ { 
    "token" : "term1", 
    "start_offset" : 0, 
    "end_offset" : 5, 
    "type" : "<ALPHANUM>", 
    "position" : 1 
    }, { 
    "token" : "term2", 
    "start_offset" : 6, 
    "end_offset" : 11, 
    "type" : "<ALPHANUM>", 
    "position" : 2 
    }, { 
    "token" : "term3", 
    "start_offset" : 12, 
    "end_offset" : 17, 
    "type" : "<ALPHANUM>", 
    "position" : 3 
    }, { 
    "token" : "term4", 
    "start_offset" : 18, 
    "end_offset" : 23, 
    "type" : "<ALPHANUM>", 
    "position" : 4 
    }, { 
    "token" : "term5", 
    "start_offset" : 24, 
    "end_offset" : 29, 
    "type" : "<ALPHANUM>", 
    "position" : 5 
    }, { 
    "token" : "RWHPSA951000155", 
    "start_offset" : 30, 
    "end_offset" : 45, 
    "type" : "<ALPHANUM>", 
    "position" : 6 
    }, { 
    "token" : "2013", 
    "start_offset" : 46, 
    "end_offset" : 50, 
    "type" : "<NUM>", 
    "position" : 7 
    }, { 
    "token" : "05", 
    "start_offset" : 51, 
    "end_offset" : 53, 
    "type" : "<NUM>", 
    "position" : 8 
    }, { 
    "token" : "27", 
    "start_offset" : 54, 
    "end_offset" : 56, 
    "type" : "<NUM>", 
    "position" : 9 
    }, { 
    "token" : "log", 
    "start_offset" : 57, 
    "end_offset" : 60, 
    "type" : "<ALPHANUM>", 
    "position" : 10 
    } ] 
}