fs2-kafka | Kafka client for functional streams for scala | Stream Processing library

by Spinoco Scala Version: v0.2.0 License: MIT

X-Ray Key Features Code Snippets Community Discussions(2)Vulnerabilities Install Support

kandi X-RAY | fs2-kafka Summary

fs2-kafka is a Scala library typically used in Data Processing, Stream Processing, Kafka applications. fs2-kafka has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. You can download it from GitHub.

fs2-kafka is a simple client for consuming and publishing messages from / to Apache Kafka. It has minimalistic functionality and is fully implemented without any dependency on kafka native driver. It is fully asynchronous and non-blocking. Thanks to fs2, it comes with full backpressure and streaming support out of the box, and plays well with other fs2 libraries such as fs2-http. fs2-kafka was built with minimal dependencies (apart from fs2, only scodec and shapeless is used). fs2-kafka only supports a subset of features compared to the native kafka client. There is for example no support for creating/administering topics and partitions, or for Kafka Connect / Kafka Streams. The reason for that is that we wanted the client to be as simple as possible, thus leaving all non-essential functionality to other solutions. Please note there is also no support for SASL Kafka protocol now.

Support

Quality

Security

License

Reuse

Support

fs2-kafka has a low active ecosystem.

It has 78 star(s) with 14 fork(s). There are 15 watchers for this library.

It had no major release in the last 12 months.

There are 9 open issues and 6 have been closed. On average issues are closed in 168 days. There are 1 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of fs2-kafka is v0.2.0

Quality

fs2-kafka has 0 bugs and 22 code smells.

Security

fs2-kafka has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

fs2-kafka code analysis shows 0 unresolved vulnerabilities.

There are 1 security hotspots that need review.

License

fs2-kafka is licensed under the MIT License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

fs2-kafka releases are available to install and integrate.

Installation instructions are not available. Examples and code snippets are available.

It has 1994 lines of code, 121 functions and 20 files.

It has medium code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of fs2-kafka

Get all kandi verified functions for this library.

fs2-kafka Key Features

No Key Features are available at this moment for fs2-kafka.

fs2-kafka Examples and Code Snippets

No Code Snippets are available at this moment for fs2-kafka.

Community Discussions

Trending Discussions on fs2-kafka

A journey from akka-stream to fs2 - how to define an akka-stream http flow like stage in fs2 using http4s

How to read from embedded-kafka with fs2-kafka

QUESTION

A journey from akka-stream to fs2 - how to define an akka-stream http flow like stage in fs2 using http4s

Asked 2021-Oct-09 at 16:10

i'm on my journey to deepen my knowledge in fs2, and want to try fs2-kafka for a use case where i would replace akka stream. The idea is simple, read from kafka and post data via http request to a sink, then commit back to kafka on success. So far i can't really figure out the http part. In akka stream / akka http you have out of the box a flow for that https://doc.akka.io/docs/akka-http/current/client-side/host-level.html#using-a-host-connection-pool

...

ANSWER

Answered 2021-Oct-09 at 16:10

The thing with the typelevel ecosystem is that everything is just a library, you don't need examples on how many of them interact together, you just need to understand how each library works and the basic rules of composition.

Source https://stackoverflow.com/questions/69503676

QUESTION

How to read from embedded-kafka with fs2-kafka

Asked 2020-Jul-01 at 15:31

I am using fs2-kafka to read from embedded-kafka.

I create the embedded kafka using withRunningKafkaOnFoundPort, create topic and publish a few messages. However when I try to read it back with fs2-kafka I get a NullPointerException. I have isolated a test case and the code is below.

Here is my code:

...

ANSWER

Answered 2020-Jul-01 at 15:31

Turns out the problem is that the key type in ConsumerSettings[IO, String, String] is String but embedded-kafka writes Null as a key, so on deserializing the key it fails with NullPointerException. Setting key type to Unit solves the problem with exception.

Another problem is that withRunningKafkaOnFoundPort finished before the evaluation of the IO starts. To have it running it is needed to make a Resource from embedded-kafka and wrap the IO into that.

Source https://stackoverflow.com/questions/62598197

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install fs2-kafka

You can download it from GitHub.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: