運行logstash作爲碼頭集裝箱內的dameon

Question

公平起見，我所要做的就是將metricbeat發送syssearch到elasticsearch並在kibana上查看它們。

我通過elasticsearch文檔閱讀，試圖找到線索。 我基於python我的形象，因爲我的實際應用程序是用python編寫的，我最終的目標是發送所有日誌（通過metricbeat的sys統計數據，以及通過filebeat的應用程序日誌）以獲得彈性。

我似乎無法找到一種方法來運行logstash作爲容器內的服務。

我dockerfile：

FROM python:2.7 

WORKDIR /var/local/myapp 
COPY . /var/local/myapp 

# logstash 
RUN wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | apt-key add - 
RUN apt-get update && apt-get install apt-transport-https dnsutils default-jre apt-utils -y 
RUN echo "deb https://artifacts.elastic.co/packages/5.x/apt stable main" | tee -a /etc/apt/sources.list.d/elastic-5.x.list 
RUN apt-get update && apt-get install logstash 

# metricbeat 
#RUN wget https://artifacts.elastic.co/downloads/beats/metricbeat/metricbeat-5.6.0-amd64.deb 
RUN dpkg -i metricbeat-5.6.0-amd64.deb 

RUN pip install --no-cache-dir -r requirements.txt 

RUN apt-get autoremove -y 

CMD bash strap_and_run.sh 

和額外的腳本strap_and_run.sh：

python finalize_config.py 

# start 
echo "starting logstash..." 
systemctl start logstash.service 

#todo :get my_ip 
echo "starting metric beat..." 
/etc/init.d/metricbeat start 

finalize_config.py

import os 

import requests 

LOGSTASH_PIPELINE_FILE = 'logstash_pipeline.conf' 
LOGSTASH_TARGET_PATH = '/etc/logstach/conf.d' 

METRICBEAT_FILE = 'metricbeat.yml' 
METRICBEAT_TARGET_PATH = os.path.join(os.getcwd, '/metricbeat-5.6.0-amd64.deb') 

my_ip = requests.get("https://api.ipify.org/").content 

ELASTIC_HOST = os.environ.get('ELASTIC_HOST') 
ELASTIC_USER = os.environ.get('ELASTIC_USER') 
ELASTIC_PASSWORD = os.environ.get('ELASTIC_PASSWORD') 

if not os.path.exists(os.path.join(LOGSTASH_TARGET_PATH)): 
    os.makedirs(os.path.join(LOGSTASH_TARGET_PATH)) 

# read logstash template file 
with open(LOGSTASH_PIPELINE_FILE, 'r') as logstash_f: 
    lines = logstash_f.readlines() 
    new_lines = [] 
    for line in lines: 
     new_lines.append(line 
         .replace("<elastic_host>", ELASTIC_HOST) 
         .replace("<elastic_user>", ELASTIC_USER) 
         .replace("<elastic_password>", ELASTIC_PASSWORD)) 

# write current file 
with open(os.path.join(LOGSTASH_TARGET_PATH, LOGSTASH_PIPELINE_FILE), 'w+') as new_logstash_f: 
    new_logstash_f.writelines(new_lines) 

if not os.path.exists(os.path.join(METRICBEAT_TARGET_PATH)): 
    os.makedirs(os.path.join(METRICBEAT_TARGET_PATH)) 


# read metricbeath template file 
with open(METRICBEAT_FILE, 'r') as metric_f: 
    lines = metric_f.readlines() 

    new_lines = [] 
    for line in lines: 
     new_lines.append(line 
         .replace("<ip-field>", my_ip) 
         .replace("<type-field>", "test")) 

# write current file 
with open(os.path.join(METRICBEAT_TARGET_PATH, METRICBEAT_FILE), 'w+') as new_metric_f: 
    new_metric_f.writelines(new_lines) 

Answer 1

的原因是存在的容器內沒有初始化系統。所以你不應該使用service或systemctl。所以你應該自己開始在後臺進程。更新後的腳本看起來像下面

python finalize_config.py 

# start 
echo "starting logstash..." 
/usr/bin/logstash & 

#todo :get my_ip 
echo "starting metric beat..." 
/usr/bin/metric start & 

wait 

您還需要添加處理的期限和其他信號，並殺死子進程。如果你不這樣做docker stop將有幾個問題。

我在這樣的情況下傾向於使用像supervisord和運行監督員爲主體的PID的過程經理1.