kafka_exporter | Kafka exporter for Prometheus | Pub Sub library
kandi X-RAY | kafka_exporter Summary
kandi X-RAY | kafka_exporter Summary
Kafka exporter for Prometheus
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of kafka_exporter
kafka_exporter Key Features
kafka_exporter Examples and Code Snippets
Community Discussions
Trending Discussions on kafka_exporter
QUESTION
I want to expose kafka and zookeeper metrics in prometheus. I do not want to use jmx_exporter because to integrate this I need to expose a port which has security vulnerabilities. Prometheus also has a third-party kafka_exporter. Is it possible to use Kafka_exporter without exposing jmx port? Or is there any other way I can get Kafka and zookeeper metrics?
...ANSWER
Answered 2020-Jan-22 at 18:06AFAIK, there are multiple "kafka exporters" for prometheus
This one is written in Golang, and does not require JMX.
You could also set com.sun.management.jmxremote.registry.ssl=true
to protect the JMX ports to clients with valid keys
QUESTION
Can you help me with my installation? I have kafka cluster on 3 nodes: kafka1:9092, kafka2:9092, kafka3: 9092 And I want to get metrics from these nodes. I download node_exporter and installed it on one node - kafka1. My service file last version:
...ANSWER
Answered 2019-Jul-09 at 16:33Kafka does not send any metrics to Prometheus. The Prometheus server will pull metrics from your metrics API.
But I can recommend that it is better to use official JMX exporter.
First download the agent:
QUESTION
I have an kafka cluster (3 machine with 1 zookeeper and 1 broker run on each machine) I am using kafka_exporter to monitoring consumer lag metric, it's work fine in normal case. But, when i kill 1 broker, the Prometheus cannot get metric from http://machine1:9308/metric (kafka_exporter metric endpoint), because it take a long time to get data (1,5m), so it will be timeout. Now, if I restart kafka_exporter I will see some error:
...ANSWER
Answered 2019-Jun-07 at 17:46The leader being -1 means that there is no other broker in the cluster that has a copy of the data for the partition.
The problem in your case is that the replication factor for your topic __consumer_offsets is 1, which means that there is only one broker that hosts the data of any partition in the topic. If you lose any one of the brokers, all the partitions on the broker become unavailable resulting in the topic becoming unavailable. So, your kafka_exporter will fail to read from this topic.
The fix to this if you want to continue exporting consumer offsets on a broker loss, is to reconfigure the topic __consumer_offsets to have replication factor more than 1.
Advised Config - Replication factor - 3, min.insync.replicas - 2.
QUESTION
version: '3.4'
services:
kafka_exporter:
image: danielqsj/kafka-exporter
command: --kafka.server=xx.xx.xx.xx:9092 --kafka.server=xx.xx.xx.xx:9092
ports:
- 9308:9308
links:
- prometheus
prometheus:
image: prom/prometheus
ports:
- 9090:9090
volumes:
- ./mount/prometheus:/etc/prometheus
command: --config.file=/etc/prometheus/prometheus.yml
...ANSWER
Answered 2018-Aug-29 at 10:26It should be container_name:port
QUESTION
I successfully deployed helm chart prometheus operator, kube-prometheus and kafka (tried both image danielqsj/kafka_exporter v1.0.1
and v1.2.0
).
Install with default value mostly, rbac are enabled.
I can see 3 up
nodes in Kafka target list in prometheus, but when go in Grafana, I can's see any kafka metric with kafka overview
Anything I missed or what I can check to fix this issue?
I can see metrics start with java_
, kafka_
, but no jvm_
and only few jmx_
metrics.
I found someone reported similar issue (https://groups.google.com/forum/#!searchin/prometheus-users/jvm_%7Csort:date/prometheus-users/OtYM7qGMbvA/dZ4vIfWLAgAJ), So I deployed with old version of jmx exporter from 0.6 to 0.9, still no jvm_
metrics.
Are there anything I missed?
env:kuberentes: AWS EKS (kubernetes version is 1.10.x)
public grafana dashboard: kafka overview
...ANSWER
Answered 2018-Jul-17 at 16:30You have to turn on jmx and exporter for kafka helm chart providing --set prometheus.jmx.enabled=true,prometheus.kafka.enabled=true
. The values are false
per default.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install kafka_exporter
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page