gearpump | Lightweight real-time big data streaming engine over Akka | Stream Processing library

 by   gearpump Scala Version: 0.9.0 License: Apache-2.0

kandi X-RAY | gearpump Summary

kandi X-RAY | gearpump Summary

gearpump is a Scala library typically used in Data Processing, Stream Processing, Kafka applications. gearpump has no bugs, it has no vulnerabilities, it has a Permissive License and it has medium support. You can download it from GitHub.

Gearpump is a lightweight real-time big data streaming engine. It is inspired by recent advances in the Akka framework and a desire to improve on existing streaming frameworks. The name Gearpump is a reference to the engineering term "gear pump", which is a super simple pump that consists of only two gears, but is very powerful at streaming water. We model streaming within the Akka actor hierarchy. Per initial benchmarks we are able to process near 18 million messages/second (100 bytes per message) with a 8ms latency on a 4-node cluster. For steps to reproduce the performance test, please check Performance benchmark.
Support
    Quality
      Security
        License
          Reuse

            kandi-support Support

              gearpump has a medium active ecosystem.
              It has 748 star(s) with 162 fork(s). There are 93 watchers for this library.
              OutlinedDot
              It had no major release in the last 12 months.
              There are 5 open issues and 992 have been closed. On average issues are closed in 134 days. There are 91 open pull requests and 0 closed requests.
              It has a neutral sentiment in the developer community.
              The latest version of gearpump is 0.9.0

            kandi-Quality Quality

              gearpump has no bugs reported.

            kandi-Security Security

              gearpump has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

            kandi-License License

              gearpump is licensed under the Apache-2.0 License. This license is Permissive.
              Permissive licenses have the least restrictions, and you can use them in most projects.

            kandi-Reuse Reuse

              gearpump releases are available to install and integrate.
              Installation instructions, examples and code snippets are available.

            Top functions reviewed by kandi - BETA

            kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
            Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of gearpump
            Get all kandi verified functions for this library.

            gearpump Key Features

            No Key Features are available at this moment for gearpump.

            gearpump Examples and Code Snippets

            No Code Snippets are available at this moment for gearpump.

            Community Discussions

            QUESTION

            java.lang.VerifyError after shading with sbt-assembly
            Asked 2017-Feb-15 at 11:57

            We've seen a similar issue in Gearpump as reported in java.lang.VerifyError: using spark with akka after shading with sbt-assembly. The error is like

            ...

            ANSWER

            Answered 2017-Feb-15 at 11:57

            Looks like an asm bug. We found a workaround for Gearpump that fixes sbt-assembly (https://github.com/sbt/sbt-assembly/issues/205#issuecomment-279967557).

            Thanks to https://github.com/pomadchin there is a PR waiting to be approved (https://github.com/sbt/sbt-assembly/pull/237)

            Source https://stackoverflow.com/questions/41820257

            Community Discussions, Code Snippets contain sources that include Stack Exchange Network

            Vulnerabilities

            No vulnerabilities reported

            Install gearpump

            1). Clone the Gearpump repository. After the build, there will be a package file gearpump-${version}.zip generated under output/target/ folder. To build scala document, use.

            Support

            For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .
            Find more information at:

            Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items

            Find more libraries
            CLONE
          • HTTPS

            https://github.com/gearpump/gearpump.git

          • CLI

            gh repo clone gearpump/gearpump

          • sshUrl

            git@github.com:gearpump/gearpump.git

          • Stay Updated

            Subscribe to our newsletter for trending solutions and developer bootcamps

            Agree to Sign up and Terms & Conditions

            Share this Page

            share link

            Consider Popular Stream Processing Libraries

            gulp

            by gulpjs

            webtorrent

            by webtorrent

            aria2

            by aria2

            ZeroNet

            by HelloZeroNet

            qBittorrent

            by qbittorrent

            Try Top Libraries by gearpump

            gearpump-examples

            by gearpumpScala

            gearpump-java-example

            by gearpumpJava

            gearpump-externals

            by gearpumpScala

            gearpump.github.io

            by gearpumpHTML

            gearpump-shaded-repo

            by gearpumpJava