gearpump | Lightweight real-time big data streaming engine over Akka | Stream Processing library
kandi X-RAY | gearpump Summary
kandi X-RAY | gearpump Summary
Gearpump is a lightweight real-time big data streaming engine. It is inspired by recent advances in the Akka framework and a desire to improve on existing streaming frameworks. The name Gearpump is a reference to the engineering term "gear pump", which is a super simple pump that consists of only two gears, but is very powerful at streaming water. We model streaming within the Akka actor hierarchy. Per initial benchmarks we are able to process near 18 million messages/second (100 bytes per message) with a 8ms latency on a 4-node cluster. For steps to reproduce the performance test, please check Performance benchmark.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of gearpump
gearpump Key Features
gearpump Examples and Code Snippets
Community Discussions
Trending Discussions on gearpump
QUESTION
We've seen a similar issue in Gearpump as reported in java.lang.VerifyError: using spark with akka after shading with sbt-assembly. The error is like
...ANSWER
Answered 2017-Feb-15 at 11:57Looks like an asm bug. We found a workaround for Gearpump that fixes sbt-assembly (https://github.com/sbt/sbt-assembly/issues/205#issuecomment-279967557).
Thanks to https://github.com/pomadchin there is a PR waiting to be approved (https://github.com/sbt/sbt-assembly/pull/237)
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install gearpump
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page