kandi background
Explore Kits

storm-kafka-starter | Example using Storm Kafka | Pub Sub library

 by   thehydroimpulse Java Version: Current License: Non-SPDX

 by   thehydroimpulse Java Version: Current License: Non-SPDX

Download this library from

kandi X-RAY | storm-kafka-starter Summary

storm-kafka-starter is a Java library typically used in Messaging, Pub Sub, MongoDB, Kafka applications. storm-kafka-starter has no bugs, it has no vulnerabilities, it has build file available and it has low support. However storm-kafka-starter has a Non-SPDX License. You can download it from GitHub.
Example using Storm + Kafka.
Support
Support
Quality
Quality
Security
Security
License
License
Reuse
Reuse

kandi-support Support

  • storm-kafka-starter has a low active ecosystem.
  • It has 18 star(s) with 27 fork(s). There are 3 watchers for this library.
  • It had no major release in the last 12 months.
  • There are 0 open issues and 1 have been closed. On average issues are closed in 8 days. There are no pull requests.
  • It has a neutral sentiment in the developer community.
  • The latest version of storm-kafka-starter is current.
storm-kafka-starter Support
Best in #Pub Sub
Average in #Pub Sub
storm-kafka-starter Support
Best in #Pub Sub
Average in #Pub Sub

quality kandi Quality

  • storm-kafka-starter has 0 bugs and 0 code smells.
storm-kafka-starter Quality
Best in #Pub Sub
Average in #Pub Sub
storm-kafka-starter Quality
Best in #Pub Sub
Average in #Pub Sub

securitySecurity

  • storm-kafka-starter has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.
  • storm-kafka-starter code analysis shows 0 unresolved vulnerabilities.
  • There are 0 security hotspots that need review.
storm-kafka-starter Security
Best in #Pub Sub
Average in #Pub Sub
storm-kafka-starter Security
Best in #Pub Sub
Average in #Pub Sub

license License

  • storm-kafka-starter has a Non-SPDX License.
  • Non-SPDX licenses can be open source with a non SPDX compliant license, or non open source licenses, and you need to review them closely before use.
storm-kafka-starter License
Best in #Pub Sub
Average in #Pub Sub
storm-kafka-starter License
Best in #Pub Sub
Average in #Pub Sub

buildReuse

  • storm-kafka-starter releases are not available. You will need to build from source code and install.
  • Build file is available. You can build the component from source.
  • Installation instructions are not available. Examples and code snippets are available.
  • storm-kafka-starter saves you 9407 person hours of effort in developing the same functionality from scratch.
  • It has 19212 lines of code, 314 functions and 72 files.
  • It has medium code complexity. Code complexity directly impacts maintainability of the code.
storm-kafka-starter Reuse
Best in #Pub Sub
Average in #Pub Sub
storm-kafka-starter Reuse
Best in #Pub Sub
Average in #Pub Sub
Top functions reviewed by kandi - BETA

kandi has reviewed storm-kafka-starter and discovered the below as its top functions. This is intended to give you an instant insight into storm-kafka-starter implemented functionality, and help decide if they suit your requirements.

  • prepare topology
    • Build storm topology .
      • Run a Topology
        • Compares two ranks .
          • Generate a random sentence .
            • Removes zero values from counter
              • Wrap topology
                • Construct a builder for a planology .
                  • Process a tuple and emit the ranking .
                    • Returns the rank of the specified object .

                      Get all kandi verified functions for this library.

                      Get all kandi verified functions for this library.

                      storm-kafka-starter Key Features

                      Example using Storm + Kafka.

                      Community Discussions

                      Trending Discussions on storm-kafka-starter
                      • Reading Kafka messages with Apache Storm in a Java Spring application causing NotSerializeableException, why?
                      Trending Discussions on storm-kafka-starter

                      QUESTION

                      Reading Kafka messages with Apache Storm in a Java Spring application causing NotSerializeableException, why?

                      Asked 2018-Aug-08 at 06:15

                      I'm new to Apache Storm and trying to get my feet wet.

                      Right now I simply want to log or print incoming Kafka messages which are received as byte arrays of ProtoBuf objects.

                      I need to do this within a Java Spring application.

                      I'm using Kafka 0.11.0.2

                      I'm using Storm 1.1.2 and have storm-core, storm-kafka, and storm-starters in my pom.

                      Main service class example

                      //annotations for spring
                      public class MyService{
                      
                          public static void main(String[] args){
                              SpringApplication.run(MyService.class, args);
                          }
                      
                          @PostConstruct
                          public void postConstruct() throws Exception {
                              SpoutConfig spoutConfig = new SpoutConfig(new ZKHosts("localhost:9092"), "topic", "/topic", "storm-spout");
                      
                              KafkaSpout kafkaSpout = new KafkaSpout(spoutConfig);
                      
                              TopologyBuilder builder = new TopologyBuilder();
                              builder.setSpout("storm-spout", kafkaSpout);
                              builder.setBolt("printer", new PrinterBolt())
                                  .shuffleGrouping("storm-spout");
                      
                              Config config = new Config();
                              config.setDebug(true);
                              config.setMaxTaskParallelism(3);
                              LocalCluster cluster = new LocalCluster();
                              cluster.submitTopology("kafka", config, builder.createTopology());
                      
                              Thread.sleep(30000);
                              cluster.shutdown();
                          }
                      
                          private class PrinterBolt extends BaseBasicBolt {
                      
                              @Override
                              public void execute(Tuple input, BasicOutputCollector){
                                  System.out.println("\n\n INPUT: "+input.toString()+"\n\n");
                              }
                      
                              @Override
                              public void declareOutputFields(OutputFieldsDeclarer declarer){}
                          }
                      
                      }
                      

                      I build a docker image from this with a Dockerfile that I know works with my environment for other spring apps and run it in a container it throws an exception and hangs.

                      The exception is java.io.NotSerializeableException

                      and I see Caused by java.lang.IllegalStateException: Bolt 'printer' contains a non-seriablizeable field of type my.package.MyService$$EnhancerBySpringCGLIB$$696afb49, which was instantiated prior to topology creation. my.package.MyService$$EnhancerBySpringCLGIB$$696afb49 should be instantiated within the prepare method of 'printer at the earliest.

                      I figure maybe it's because storm is trying and failing to serialize the incoming byte array but I'm not sure how to remedy that and I haven't seen a lot of people trying to do this.

                      I was using this as a reference. https://github.com/thehydroimpulse/storm-kafka-starter/blob/master/src/jvm/storm/starter/KafkaTopology.java

                      ANSWER

                      Answered 2018-Aug-08 at 06:15

                      Either declare PrinterBolt in a new file, or make the class static. The problem you're running into is that PrinterBolt is a non-static inner class of MyService, which means it contains a reference to the outer MyService class. Since MyService isn't serializable, PrinterBolt isn't either. Storm requires bolts to be serializable.

                      Also unrelated to the error you're seeing, you might want to consider using storm-kafka-client over storm-kafka, since the latter is deprecated.

                      Source https://stackoverflow.com/questions/51736100

                      Community Discussions, Code Snippets contain sources that include Stack Exchange Network

                      Vulnerabilities

                      No vulnerabilities reported

                      Install storm-kafka-starter

                      You can download it from GitHub.
                      You can use storm-kafka-starter like any standard Java library. Please include the the jar files in your classpath. You can also use any IDE and you can run and debug the storm-kafka-starter component as you would do with any other Java program. Best practice is to use a build tool that supports dependency management such as Maven or Gradle. For Maven installation, please refer maven.apache.org. For Gradle installation, please refer gradle.org .

                      Support

                      For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

                      DOWNLOAD this Library from

                      Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from
                      over 430 million Knowledge Items
                      Find more libraries
                      Reuse Solution Kits and Libraries Curated by Popular Use Cases
                      Explore Kits

                      Save this library and start creating your kit

                      Share this Page

                      share link
                      Consider Popular Pub Sub Libraries
                      Try Top Libraries by thehydroimpulse
                      Compare Pub Sub Libraries with Highest Support
                      Compare Pub Sub Libraries with Highest Quality
                      Compare Pub Sub Libraries with Highest Security
                      Compare Pub Sub Libraries with Permissive License
                      Compare Pub Sub Libraries with Highest Reuse
                      Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from
                      over 430 million Knowledge Items
                      Find more libraries
                      Reuse Solution Kits and Libraries Curated by Popular Use Cases
                      Explore Kits

                      Save this library and start creating your kit

                      • © 2022 Open Weaver Inc.