fluent-plugin-kafka | Kafka input and output plugin for Fluentd | Pub Sub library

by fluent Ruby Version: v0.19.0 License: Non-SPDX

X-Ray Key Features Code Snippets Community Discussions(2)Vulnerabilities Install Support

kandi X-RAY | fluent-plugin-kafka Summary

fluent-plugin-kafka is a Ruby library typically used in Messaging, Pub Sub, Kafka applications. fluent-plugin-kafka has no bugs, it has no vulnerabilities and it has low support. However fluent-plugin-kafka has a Non-SPDX License. You can download it from GitHub.

A fluentd plugin to both consume and produce data for Apache Kafka.

Support

Quality

Security

License

Reuse

Support

fluent-plugin-kafka has a low active ecosystem.

It has 294 star(s) with 174 fork(s). There are 33 watchers for this library.

It had no major release in the last 6 months.

There are 21 open issues and 252 have been closed. On average issues are closed in 150 days. There are no pull requests.

It has a neutral sentiment in the developer community.

The latest version of fluent-plugin-kafka is v0.19.0

Quality

fluent-plugin-kafka has 0 bugs and 26 code smells.

Security

fluent-plugin-kafka has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

fluent-plugin-kafka code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

fluent-plugin-kafka has a Non-SPDX License.

Non-SPDX licenses can be open source with a non SPDX compliant license, or non open source licenses, and you need to review them closely before use.

Reuse

fluent-plugin-kafka releases are not available. You will need to build from source code and install.

Installation instructions, examples and code snippets are available.

fluent-plugin-kafka saves you 1203 person hours of effort in developing the same functionality from scratch.

It has 3312 lines of code, 191 functions and 18 files.

It has high code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi has reviewed fluent-plugin-kafka and discovered the below as its top functions. This is intended to give you an instant insight into fluent-plugin-kafka implemented functionality, and help decide if they suit your requirements.

Creates a new chunk instance .
Executes the given number of partitions .
Initializes the configuration object .
Assign a message to the Kafka brokers .
Creates a new Kafka producer .
Create a new client
Enqueue a record in the queue .
All queues for messages .
Produce a new message to be delivered .
Setup the config file .

Get all kandi verified functions for this library.

fluent-plugin-kafka Key Features

No Key Features are available at this moment for fluent-plugin-kafka.

fluent-plugin-kafka Examples and Code Snippets

No Code Snippets are available at this moment for fluent-plugin-kafka.

Community Discussions

Trending Discussions on fluent-plugin-kafka

Why is Fluentd Azure blob plugin not working in kubernetes

fluent plugin kafka json escaping

QUESTION

Why is Fluentd Azure blob plugin not working in kubernetes

Asked 2020-Feb-25 at 08:19

I've installed fluentd in my AKS cluster using the following command helm install fluentd bitnami-azure/fluentd --namespace mynamespace --set forwarder.configMap=fluentd-aksconfig.

Below is my configmap.yaml

...

ANSWER

Answered 2020-Feb-25 at 08:19

As said by @ArghyaSadhu in his answer, Currently fluentd docker image does not come with azure blob plugin pre-installed. We can obtain the docker image and customize it. Please refer to the following link on how to customize fluentd's docker image. https://github.com/bitnami/bitnami-docker-fluentd#customize-this-image

Source https://stackoverflow.com/questions/60278431

QUESTION

fluent plugin kafka json escaping

Asked 2020-Feb-17 at 15:57

I am using version fluent-plugin-kafka version 0.12.3.

I have an application that outputs its logs in JSON format, but my console consumer shows that the logs are escaped.

for instance, the application output the following log line:

...

ANSWER

Answered 2020-Feb-17 at 14:54

using record transformer filter i was able to mutate the incoming data.

Source https://stackoverflow.com/questions/60215884

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install fluent-plugin-kafka

Add this line to your application's Gemfile:.

Support

Consume events by kafka consumer group features.. See also ruby-kafka README for more detailed documentation about ruby-kafka options. topics supports regex pattern since v0.13.1. If you want to use regex pattern, use /pattern/ like /foo.*/. Consuming topic name is used for event tag. So when the target topic name is app_event, the tag is app_event. If you want to modify tag, use add_prefix or add_suffix parameter. With add_prefix kafka, the tag is kafka.app_event.

Find more information at: