research-blog | A Ghost Theme that is similar to Distill.pub 's style | Theme library
kandi X-RAY | research-blog Summary
kandi X-RAY | research-blog Summary
A Ghost Theme that is similar to Distill.pub's style.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of research-blog
research-blog Key Features
research-blog Examples and Code Snippets
Community Discussions
Trending Discussions on research-blog
QUESTION
1,Based on the description below, Both Storm and Spark Streaming dealing with the messages/tuples in batch or small/micro batch? https://storm.apache.org/releases/2.0.0-SNAPSHOT/Trident-tutorial.html
2,If the answer for the above question is yes, it means both technologies have the delay when dealing with the messages/tuples ? If that's the case why I heard often that latency for the Storm is better then Spark Streaming ,such as the below article? https://www.ericsson.com/research-blog/data-knowledge/apache-storm-vs-spark-streaming/
3,From the Trident-tutorial it describes that : "Generally the size of those small batches will be on the order of thousands or millions of tuples, depending on your incoming throughput." So what's the really size of the small batch? thousands or millions of tuples?If it is , how Storm can keep the short latency?
https://storm.apache.org/releases/2.0.0-SNAPSHOT/Trident-tutorial.html
...ANSWER
Answered 2017-May-30 at 04:21Storm's core api tries to process an event as it arrives. Its an event at a time processing model which can result in very low latencies.
Storm's Trident is a micro batching model built on top of the storm's core apis for providing exactly-once guarantees. Spark streaming is also based on micro batching and comparable to trident in terms of latencies.
So if one is looking for extremely low latency processing Storm's core api would be the way to go. However this guarantees only at-least once processing and theres a chance of receiving duplicate events in case of failures and the application is expected to handle this.
Take a look at the streaming benchmark from yahoo [1], that can provide more insights.
[1] https://yahooeng.tumblr.com/post/135321837876/benchmarking-streaming-computation-engines-at
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install research-blog
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page