快捷導(dǎo)航

prometheus數(shù)據(jù)遠(yuǎn)程寫入elasticsearch方式

更新時(shí)間：2025年06月23日 09:47:42 作者：yololee_

這篇文章主要介紹了prometheus數(shù)據(jù)遠(yuǎn)程寫入elasticsearch方式,具有很好的參考價(jià)值,希望對(duì)大家有所幫助,如有錯(cuò)誤或未考慮完全的地方,望不吝賜教

prometheus數(shù)據(jù)遠(yuǎn)程寫入elasticsearch

一、部署elasticsearch

version: '3'

# 網(wǎng)橋es -> 方便相互通訊
networks:
  es:
    driver: bridge

services:
  elasticsearch:
    image: elasticsearch:7.14.1
    container_name: elasticsearch             # 容器名為'elasticsearch'
    restart: unless-stopped                           # 指定容器退出后的重啟策略為始終重啟，但是不考慮在Docker守護(hù)進(jìn)程啟動(dòng)時(shí)就已經(jīng)停止了的容器
    volumes:                                  # 數(shù)據(jù)卷掛載路徑設(shè)置,將本機(jī)目錄映射到容器目錄
      - "./elasticsearch/data:/usr/share/elasticsearch/data"
      - "./elasticsearch/logs:/usr/share/elasticsearch/logs"
      - "./elasticsearch/config/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml"
#      - "./elasticsearch/config/jvm.options:/usr/share/elasticsearch/config/jvm.options"
      - "./elasticsearch/plugins/ik:/usr/share/elasticsearch/plugins/ik" # IK中文分詞插件
    environment:                              # 設(shè)置環(huán)境變量,相當(dāng)于docker run命令中的-e
      TZ: Asia/Shanghai
      LANG: en_US.UTF-8
      TAKE_FILE_OWNERSHIP: "true"  # 權(quán)限
      discovery.type: single-node
      ES_JAVA_OPTS: "-Xmx512m -Xms512m"
      ELASTIC_PASSWORD: "123456" # elastic賬號(hào)密碼
    ports:
      - "9200:9200"
      - "9300:9300"
    networks:
      - es

  kibana:
    image: kibana:7.14.1
    container_name: kibana
    restart: unless-stopped
    volumes:
      - ./elasticsearch/kibana/config/kibana.yml:/usr/share/kibana/config/kibana.yml
    ports:
      - "5601:5601"
    depends_on:
      - elasticsearch
    links:
      - elasticsearch
    networks:
      - es

其中的配置文件和插件查看地址：https://gitee.com/huanglei1111/docker-compose/tree/master/Linux/elasticsearch

查看是否運(yùn)行成功

訪問elasticsearch：ip:端口

訪問kibana：ip:端口

用戶名：elastic
密碼：123456

二、部署prometheus

version: "3"

# 網(wǎng)橋 -> 方便相互通訊
networks:
  prometheus:
    ipam:
      driver: default
      config:
        - subnet: "172.22.0.0/24"
services:
  # 開源的系統(tǒng)監(jiān)控和報(bào)警系統(tǒng)
  prometheus:
    image: prom/prometheus:v2.34.0
    container_name: hl-prometheus
    restart: unless-stopped
    volumes:
      - ./config/prometheus.yml:/etc/prometheus/prometheus.yml
      # - "./web-config.yml:/etc/prometheus/web-config.yml"
    command: 
      --config.file=/etc/prometheus/prometheus.yml
      --web.enable-lifecycle
      # --web.config.file=/etc/prometheus/web-config.yml
    ports:
      - "19090:9090"
    depends_on:
      - hl-node-exporter
    networks:
      prometheus:
        ipv4_address: 172.22.0.11

  # 采集服務(wù)器層面的運(yùn)行指標(biāo)
  node-exporter:
    image: prom/node-exporter:v1.3.1
    container_name: hl-node-exporter
    restart: unless-stopped
    volumes:
      - "./node-exporter/proc:/host/proc:ro"
      - "./node-exporter/sys:/host/sys:ro"
      - "./node-exporter:/rootfs:ro"
    ports:
      - "19100:9100"
    networks:
      prometheus:
        ipv4_address: 172.22.0.22
  # 使用prometheusbeat 把prometheus的數(shù)據(jù)存儲(chǔ)到elasticsearch中
  beat:
    image: infonova/prometheusbeat
    container_name: hl-prometheusbeat
    ports:
      - 18081:8080
    depends_on:
      - hl-prometheus
    volumes:
      - "./config/prometheusbeat.yml:/prometheusbeat.yml"
      - "/etc/localtime:/etc/localtime"
    networks:
      prometheus:
         ipv4_address: 172.22.0.33

查看是否部署成功

查看監(jiān)控指標(biāo)是否健康

注意：狀態(tài)為down，注意修改prometheus.yml配置文件中targets的ip為服務(wù)器ip

三、通過prometheusbeat寫入數(shù)據(jù)到es

上面在部署docker-compose-prometheus.yml文件已經(jīng)部署啦

如果es有用戶密碼，需要在prometheusbeat.yml配置文件中添加配置

prometheusbeat:
  # prometheusbeat 服務(wù)的端口。默認(rèn)為8080
  listen: ":8080"
  # Context path. Defaults to /prometheus
  context: "/prometheus"
output.elasticsearch:
  # elasticsearch 的地址
  hosts: ["127.0.0.1:9200"]
  username: "elastic"
  password: "123456"

其次修改prometheus.yml配置文件

prometheus 通過 remote_write 來實(shí)現(xiàn)遠(yuǎn)端存儲(chǔ)，所以在 prometheus.yml 配置文件中增加 remote_write 參數(shù)

global:
  scrape_interval: 10s
  scrape_timeout: 10s
  evaluation_interval: 10m
remote_write:
# 遠(yuǎn)程寫入到prometheusbeat中
- url: "http://127.0.0.1:18081/prometheus"
  write_relabel_configs:
  - source_labels: [__name__]
    action: keep
    regex: go_gc_cycles_automatic_gc_cycles_total
  remote_timeout: 30s
scrape_configs:
  # prometheus
  - job_name: prometheus
    static_configs:
      - targets: ['127.0.0.1:19090']
        labels:
          instance: prometheus

  # 采集node exporter監(jiān)控?cái)?shù)據(jù)，即linux
  - job_name: linux
    static_configs:
      - targets: ['127.0.0.1:19100']
        labels:
          instance: localhost

配置說明

url：prometheusbeat 的服務(wù)地址
write_relabel_configs：這個(gè)很有用，用于過濾數(shù)據(jù)，可以設(shè)置多個(gè)過濾條件，同時(shí)滿足這些條件的數(shù)據(jù)才會(huì)被存到遠(yuǎn)端存儲(chǔ)！
source_labels：根據(jù)哪個(gè)字段進(jìn)行過濾
regex：值過濾的規(guī)則
action：keep(保留)/drop(丟棄)

所以，上面配置文件中的配置意思就是：prometheus 收到數(shù)據(jù)后，遠(yuǎn)程發(fā)送給 prometheusbeat，并且只發(fā)送 name 為 go_gc_cycles_automatic_gc_cycles_total

然后重啟prometheus。之后當(dāng)收集到數(shù)據(jù)時(shí)，就能成功保存到 elasticsearch 了，首次保存時(shí)會(huì)自動(dòng)創(chuàng)建索引：prometheusbeat-7.3.1，數(shù)據(jù)都存在此索引中。