ruby-kafka | A Ruby client library for Apache Kafka | Pub Sub library

by zendesk Ruby Version: v1.4.0 License: Apache-2.0

X-Ray Key Features Code Snippets Community Discussions(2)Vulnerabilities Install Support

kandi X-RAY | ruby-kafka Summary

ruby-kafka is a Ruby library typically used in Messaging, Pub Sub, Kafka applications. ruby-kafka has no bugs, it has no vulnerabilities, it has a Permissive License and it has medium support. You can download it from GitHub.

A Ruby client library for Apache Kafka

Support

Quality

Security

License

Reuse

Support

ruby-kafka has a medium active ecosystem.

It has 1238 star(s) with 350 fork(s). There are 391 watchers for this library.

It had no major release in the last 12 months.

There are 20 open issues and 346 have been closed. On average issues are closed in 102 days. There are 10 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of ruby-kafka is v1.4.0

Quality

ruby-kafka has 0 bugs and 0 code smells.

Security

ruby-kafka has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

ruby-kafka code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

ruby-kafka is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

ruby-kafka releases are available to install and integrate.

Installation instructions, examples and code snippets are available.

ruby-kafka saves you 3506 person hours of effort in developing the same functionality from scratch.

It has 7506 lines of code, 555 functions and 128 files.

It has low code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi has reviewed ruby-kafka and discovered the below as its top functions. This is intended to give you an instant insight into ruby-kafka implemented functionality, and help decide if they suit your requirements.

Initializes a new Kafka client .
Send a message to the broker .
Creates a new Kafka consumer .
Iterates over the consumer .
Execute a topic .
Process the broker response .
Iterates over the consumer .
Initialize a new Kafka broker
Assign a new partition assignment .
Extracts records from the queue .

Get all kandi verified functions for this library.

ruby-kafka Key Features

No Key Features are available at this moment for ruby-kafka.

ruby-kafka Examples and Code Snippets

No Code Snippets are available at this moment for ruby-kafka.

Community Discussions

Trending Discussions on ruby-kafka

Fluentd is unable to establish connection with Kafka brokers: Errno::ECONNRESET: Connection reset by peer

How to check to see if Ruby-Kafka retries works?

QUESTION

Fluentd is unable to establish connection with Kafka brokers: Errno::ECONNRESET: Connection reset by peer

Asked 2020-Oct-26 at 09:24

I have configured a fluentd sidecar container to send logs to kafka.

Here is my fluent.conf file:

...

ANSWER

Answered 2020-Oct-26 at 09:24

From the fluentd host, try using the https://github.com/edenhill/kafkacat to debug Kafka connectivity/access. I'm sure this is a network/firewall issue, not the fluentd.

Source https://stackoverflow.com/questions/64499789

QUESTION

How to check to see if Ruby-Kafka retries works?

Asked 2020-May-11 at 06:30

In the documentation it is mentioned that producer retries to send the message to the queue based on max_retries.

So I shutdown the Kafka and then tried my producer. I get this error

...

ANSWER

Answered 2020-May-11 at 06:30

The retries are based on the type of Exception thrown by the producer callback. According to the Callback Docs there are the following Exception possible happening during callback:

The exception thrown during processing of this record. Null if no error occurred. Possible thrown exceptions include:

Non-Retriable exceptions (fatal, the message will never be sent):

InvalidTopicException
OffsetMetadataTooLargeException
RecordBatchTooLargeException
RecordTooLargeException
UnknownServerException

Retriable exceptions (transient, may be covered by increasing #.retries):

CorruptRecordException
InchvalidMetadataException
NotEnoughReplicasAfterAppendException
NotEnoughReplicasException
OffsetOutOfRangeException
TimeoutException
UnknownTopicOrPartitionException

Shutting down Kafka completely rather looks like a non-retriable Exception.

Source https://stackoverflow.com/questions/61723344

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install ruby-kafka

Add this line to your application's Gemfile:.
A client must be initialized with at least one Kafka broker, from which the entire Kafka cluster will be discovered. Each client keeps a separate pool of broker connections. Don't use the same client from more than one thread.

Support

If you've discovered a bug, please file a Github issue, and make sure to include all the relevant information, including the version of ruby-kafka and Kafka that you're using.

Find more information at: