GKE中針對Elasticsearch的StackDriver監控

我需要監控安裝在k8s集羣頂部的Elasticsearch（2.4）。我有兩個客戶端，3個主站和幾個數據節點，它們都運行在pod中。在Stackdriver的「如何操作」和帖子「Can I run Google Monitoring Agent inside a Kubernetes Pod?」之後，我在自己的Pod中部署了一個代理。突然間，畢竟在StackDriver中沒有Elasticsearch指標。唯一的零。GKE中針對Elasticsearch的StackDriver監控

任何建議都歡迎。

這是我的配置：

彈性服務：

$kubectl describe svc elasticsearch 
Name:   elasticsearch 
Namespace:  default 
Labels:   component=elasticsearch 
      role=client 
Selector:  component=elasticsearch,role=client 
Type:   NodePort 
IP:   <IP> 
Port:   http 9200/TCP 
NodePort:  http <PORT>/TCP 
Endpoints:  <IP>:9200,<IP>:9200 
Session Affinity: None 
No events.

爲Stackdriver部署：

apiVersion: extensions/v1beta1 
kind: Deployment 
metadata: 
    name: stackagent 
spec: 
    replicas: 1 
    strategy: 
    type: Recreate 
    template: 
    metadata: 
     labels: 
     component: monitoring 
     role: stackdriver-agent 
    spec: 
     containers: 
     - name: hslab-data-agent 
     image: StackDriverAgent:version1

StackDriverAgent：VERSION1泊塢窗：

FROM ubuntu 

WORKDIR /stackdriver 

RUN apt-get update 
RUN apt-get install curl lsb-release libyajl2 -y 
RUN apt-get clean 

COPY ./stackdriver/run.sh run.sh 
COPY ./stackdriver/elasticsearch.conf elasticsearch.conf 

RUN chmod 755 ./run.sh 
CMD ["./run.sh"]

run.sh ：

#!/bin/bash 

curl -O https://repo.stackdriver.com/stack-install.sh 

chmod 755 stack-install.sh 
bash stack-install.sh --write-gcm 

cp ./elasticsearch.conf /opt/stackdriver/collectd/etc/collectd.d/ 

service stackdriver-agent restart 

while true; do 
    sleep 60 
    agent_pid=$(cat /var/run/stackdriver-agent.pid 2>/dev/null) 

    ps -p $agent_pid > /dev/null 2>&1 
    if [ $? != 0 ]; then 
     echo "Stackdriver agent pid not found!" 
     break; 
    fi 
done

elasticsearch.conf：

從https://raw.githubusercontent.com/Stackdriver/stackdriver-agent-service-configs/master/etc/collectd.d/elasticsearch.conf

# This is the monitoring configuration for Elasticsearch 1.0.x and later. 
# Look for ELASTICSEARCH_HOST and ELASTICSEARCH_PORT to adjust your configuration file. 
LoadPlugin curl_json 
<Plugin "curl_json"> 
    # When using non-standard Elasticsearch configurations, replace the below with 
    #<URL "http://ELASTICSEARCH_HOST:ELASTICSEARCH_PORT/_nodes/_local/stats/"> 
    # PREVIOUSE LINE 
    # <URL "http://localhost:9200/_nodes/_local/stats/"> 
    <URL "http://elasticsearch:9200/_nodes/_local/stats/"> 
     Instance "elasticsearch" 
....

兩者運行狀態：

NAME          READY  STATUS RESTARTS AGE 
esclient-4231471109-bd4tb     1/1  Running 0   23h 
esclient-4231471109-k5pnw     1/1  Running 0   23h 
esdata-1-2524076994-898r0     1/1  Running 0   23h 
esdata-2-2426789420-zhz7j     1/1  Running 0   23h 
esmaster-1-4205943399-zj2pn    1/1  Running 0   23h 
esmaster-2-4248445829-pwq46    1/1  Running 0   23h 
esmaster-3-3967126695-w0tp2    1/1  Running 0   23h 
stackagent-3122989159-15vj1    1/1  Running 0   18h

來源

2017-09-14 worroc

與插件configuration.The HTTP API的URL的問題：// elasticsearch：9200/_nodes/** _local **/stats /「>將只返回信息_local這是一個沒有文檔的客戶端節點。

另外，Stackdriver數據將在k8s羣集節點下收集，而不是在pod名稱下收集。

的部分解決方案是建立在跨斗的數據節點和相應的ES節點名稱修補elasticsearch.conf查詢：

得到curl [elasticsearch]:9200/_nodes/stats
由$找到ES節點名（hostname ）
修補配置<URL "http://elasticsearch:9200/_nodes/<esnode_name>/stats/">

這將收集的數據K8S節點名稱下ES的數據的節點的信息。

來源

2017-09-17 14:30:19 worroc

GKE中針對Elasticsearch的StackDriver監控

回答

相關問題