kafka_exporter | Kafka exporter for Prometheus | Pub Sub library

by danielqsj Go Version: v1.7.0 License: Apache-2.0

X-Ray Key Features Code Snippets Community Discussions(5)Vulnerabilities Install Support

kandi X-RAY | kafka_exporter Summary

kafka_exporter is a Go library typically used in Messaging, Pub Sub, Kafka, Prometheus, Grafana applications. kafka_exporter has no bugs, it has no vulnerabilities, it has a Permissive License and it has medium support. You can download it from GitHub.

Kafka exporter for Prometheus

Support

Quality

Security

License

Reuse

Support

kafka_exporter has a medium active ecosystem.

It has 1757 star(s) with 558 fork(s). There are 36 watchers for this library.

There were 1 major release(s) in the last 12 months.

There are 164 open issues and 83 have been closed. On average issues are closed in 214 days. There are 33 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of kafka_exporter is v1.7.0

Quality

kafka_exporter has no bugs reported.

Security

kafka_exporter has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

License

kafka_exporter is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

kafka_exporter releases are available to install and integrate.

Installation instructions, examples and code snippets are available.

Top functions reviewed by kandi - BETA

kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of kafka_exporter

Get all kandi verified functions for this library.

kafka_exporter Key Features

No Key Features are available at this moment for kafka_exporter.

kafka_exporter Examples and Code Snippets

No Code Snippets are available at this moment for kafka_exporter.

Community Discussions

Trending Discussions on kafka_exporter

Security vulnerabilities to JMX Exporter in Prometheus

kafka_exporter doesn't send metrics to prometheus

Kafka monitoring in cluster environment

docker prometheus not able to access docker kafka_exporter

No kafka metrics in Grafana/prometheus

QUESTION

Security vulnerabilities to JMX Exporter in Prometheus

Asked 2020-Jan-22 at 18:06

I want to expose kafka and zookeeper metrics in prometheus. I do not want to use jmx_exporter because to integrate this I need to expose a port which has security vulnerabilities. Prometheus also has a third-party kafka_exporter. Is it possible to use Kafka_exporter without exposing jmx port? Or is there any other way I can get Kafka and zookeeper metrics?

...

ANSWER

Answered 2020-Jan-22 at 18:06

AFAIK, there are multiple "kafka exporters" for prometheus

This one is written in Golang, and does not require JMX.

You could also set com.sun.management.jmxremote.registry.ssl=true to protect the JMX ports to clients with valid keys

Source https://stackoverflow.com/questions/59854212

QUESTION

kafka_exporter doesn't send metrics to prometheus

Asked 2019-Aug-19 at 18:51

Can you help me with my installation? I have kafka cluster on 3 nodes: kafka1:9092, kafka2:9092, kafka3: 9092 And I want to get metrics from these nodes. I download node_exporter and installed it on one node - kafka1. My service file last version:

...

ANSWER

Answered 2019-Jul-09 at 16:33

Kafka does not send any metrics to Prometheus. The Prometheus server will pull metrics from your metrics API.

But I can recommend that it is better to use official JMX exporter.

First download the agent:

Source https://stackoverflow.com/questions/56956571

QUESTION

Kafka monitoring in cluster environment

Asked 2019-Jun-07 at 17:46

I have an kafka cluster (3 machine with 1 zookeeper and 1 broker run on each machine) I am using kafka_exporter to monitoring consumer lag metric, it's work fine in normal case. But, when i kill 1 broker, the Prometheus cannot get metric from http://machine1:9308/metric (kafka_exporter metric endpoint), because it take a long time to get data (1,5m), so it will be timeout. Now, if I restart kafka_exporter I will see some error:

...

ANSWER

Answered 2019-Jun-07 at 17:46

The leader being -1 means that there is no other broker in the cluster that has a copy of the data for the partition.

The problem in your case is that the replication factor for your topic __consumer_offsets is 1, which means that there is only one broker that hosts the data of any partition in the topic. If you lose any one of the brokers, all the partitions on the broker become unavailable resulting in the topic becoming unavailable. So, your kafka_exporter will fail to read from this topic.

The fix to this if you want to continue exporting consumer offsets on a broker loss, is to reconfigure the topic __consumer_offsets to have replication factor more than 1.

Advised Config - Replication factor - 3, min.insync.replicas - 2.

Source https://stackoverflow.com/questions/56493087

QUESTION

docker prometheus not able to access docker kafka_exporter

Asked 2018-Aug-29 at 11:26

version: '3.4'
services:
  kafka_exporter:
    image: danielqsj/kafka-exporter
    command: --kafka.server=xx.xx.xx.xx:9092 --kafka.server=xx.xx.xx.xx:9092
    ports:
      - 9308:9308
    links:
      - prometheus
  prometheus:
    image: prom/prometheus
    ports:
    - 9090:9090
    volumes:
    - ./mount/prometheus:/etc/prometheus
    command: --config.file=/etc/prometheus/prometheus.yml

...

ANSWER

Answered 2018-Aug-29 at 10:26

It should be container_name:port

Source https://stackoverflow.com/questions/52073090

QUESTION

No kafka metrics in Grafana/prometheus

Asked 2018-Jul-17 at 23:45

I successfully deployed helm chart prometheus operator, kube-prometheus and kafka (tried both image danielqsj/kafka_exporter v1.0.1 and v1.2.0).

Install with default value mostly, rbac are enabled.

I can see 3 up nodes in Kafka target list in prometheus, but when go in Grafana, I can's see any kafka metric with kafka overview

Anything I missed or what I can check to fix this issue?

I can see metrics start with java_, kafka_, but no jvm_ and only few jmx_ metrics.

I found someone reported similar issue (https://groups.google.com/forum/#!searchin/prometheus-users/jvm_%7Csort:date/prometheus-users/OtYM7qGMbvA/dZ4vIfWLAgAJ), So I deployed with old version of jmx exporter from 0.6 to 0.9, still no jvm_ metrics.

Are there anything I missed?

env:

kuberentes: AWS EKS (kubernetes version is 1.10.x)

public grafana dashboard: kafka overview

...

ANSWER

Answered 2018-Jul-17 at 16:30

You have to turn on jmx and exporter for kafka helm chart providing --set prometheus.jmx.enabled=true,prometheus.kafka.enabled=true. The values are false per default.

Source https://stackoverflow.com/questions/51372578

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install kafka_exporter

Binary can be downloaded from [Releases](https://github.com/danielqsj/kafka_exporter/releases) page.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: