Proxy connections to Kafka cluster. Connect through SOCKS Proxy, HTTP Proxy or to cluster running in Kubernetes.
Support
Quality
Security
License
Reuse
Performance tests for Apache Spark
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
Streaming reactive and dataflow graphs in Python
Support
Quality
Security
License
Reuse
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Support
Quality
Security
License
Reuse
Data Engineering with Python, published by Packt
Support
Quality
Security
License
Reuse
A lib to consume message from any Broker
Support
Quality
Security
License
Reuse
Kafka Streams Topology Sketch Diagram Visualization
Support
Quality
Security
License
Reuse
商品大数据实时推荐系统。前端:Vue + TypeScript + ElementUI,后端 Spring + Spark
Support
Quality
Security
License
Reuse
Docker-compose files for a simple InfluxDB + Grafana stack
Support
Quality
Security
License
Reuse
KMinion is a feature-rich Prometheus exporter for Apache Kafka written in Go. It is lightweight and highly configurable so that it will meet your requirements.
Support
Quality
Security
License
Reuse
Docker configuration for ELK monitoring stack with Curator and Beats data shippers support
Support
Quality
Security
License
Reuse
A library for performing data pipeline / ETL tasks in Go.
Support
Quality
Security
License
Reuse
Scala helper modules for operating the Apache Kafka client library (0.9.x - 2.1.0)
Support
Quality
Security
License
Reuse
Mirror of Apache Apex core
Support
Quality
Security
License
Reuse
A simplified way to generate masive mock data based on a schema, using the awesome fake/random data generators like (FakerJs, ChanceJs, CasualJs and RandExpJs), all in one tool to generate your fake data for testing.
Support
Quality
Security
License
Reuse
My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggregates Twitter and US stock market data for user sentiment analysis using open source tools - Apache Kafka for data ingestions, Apache Spark & Spark Streaming for batch & real-time processing, Apache Cassandra f or storage, Flask, Bootstrap and HighCharts f or frontend.
Support
Quality
Security
License
Reuse
Change Data Capture (CDC) service
Support
Quality
Security
License
Reuse
Monitor Kafka Consumer Group Latency with Kafka Lag Exporter
Support
Quality
Security
License
Reuse
Anno 是一个微服务快速开发框架,底层通讯可以随意切换 grpc、thrift。自带服务发现、调用链追踪、Cron 调度、限流、事件总线、CQRS 、DDD、类似MVC的开发体验,插件化开发。 Anno is a microservices rapid development framework, the underlying communication can be arbitrary switch GRPC, thrift.Built-in service discovery, call chain tracking, Cron scheduling, current limiting, event bus, CQRS, DDD, similar MVC development experience, plug-in development.
Support
Quality
Security
License
Reuse
MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the items to MongoDB as soon as your spider finds data to extract.
Support
Quality
Security
License
Reuse
Manage your Kafka ACL at scale
Support
Quality
Security
License
Reuse
A fault-tolerant network service for meaningful GUID generation
Support
Quality
Security
License
Reuse
基于 Springboot + Redis + Kafka 的秒杀系统,乐观锁 + 缓存 + 限流 + 异步,TPS 从 500 优化到 3000
Support
Quality
Security
License
Reuse
HDFS-alike in Go. Written in 2014 to learn the language and get a job.
Support
Quality
Security
License
Reuse
Quick up and running using Scala for Apache Kafka
Support
Quality
Security
License
Reuse
Java SDK for CloudEvents
Support
Quality
Security
License
Reuse
M
MsSystem-BPM-ServiceAndWebAppsby wangmaosheng
JavaScript 
333
Version:Current
License: Permissive (MIT)
.net core 微服务 权限系统+工作流系统
Support
Quality
Security
License
Reuse
aliyun api gateway request signature demo by java
Support
Quality
Security
License
Reuse
🐋 IPFS-backed Docker Registry
Support
Quality
Security
License
Reuse
我的个人技术博客(Python、Django、Docker、Go、Redis、ElasticSearch、Kafka、Linux)
Support
Quality
Security
License
Reuse
Sync data from the other DB to ClickHouse(cluster)
Support
Quality
Security
License
Reuse
a
amazon-kinesis-connectorsby amazon-archives
Java 
329
Version:Current
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
Go implementation of the Data At Rest Encryption (DARE) format.
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
Airbnb's Open-source Distributed Delayed Job Queueing System
Support
Quality
Security
License
Reuse
Continuously monitors a set of log files and sends new data to the Amazon Kinesis Stream and Amazon Kinesis Firehose in near-real-time.
Support
Quality
Security
License
Reuse
Lightweight node/service registry inspired by Apache Zookeeper
Support
Quality
Security
License
Reuse
Delivers a human-readable diagnostic summary, written to file.
Support
Quality
Security
License
Reuse
A tool for data sampling, data generation, and data diffing
Support
Quality
Security
License
Reuse
Course code for Scalable Microservices with Kubernetes
Support
Quality
Security
License
Reuse
pip install function_scheduling_distributed_framework,python通用分布式函数调度框架。python万能超高并发神器,改成funboost框架名字,停止更新,只更新funboost框架。
Support
Quality
Security
License
Reuse
Generate Go code to serialize and deserialize Avro schemas
Support
Quality
Security
License
Reuse
Instagram Clone - Cloning Instagram for learning purpose
Support
Quality
Security
License
Reuse
Source code for Big Data: Principles and best practices of scalable realtime data systems
Support
Quality
Security
License
Reuse
基于Tornado实现的一套资产管理系统、支持AWS、阿里云、腾讯云、华为云自动拉取资产信息等
Support
Quality
Security
License
Reuse
提供各种客户端接入阿里云 消息队列 Kafka 的demo工程
Support
Quality
Security
License
Reuse
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
Support
Quality
Security
License
Reuse
A Bulk Data Pipeline out of Cassandra
Support
Quality
Security
License
Reuse
s
spring-cloud-stream-binder-kafkaby spring-cloud
Java 
316
Version:Current
License: Permissive (Apache-2.0)
Spring Cloud Stream binders for Apache Kafka and Kafka Streams
Support
Quality
Security
License
Reuse
k
kafka-proxyby grepplabs
Proxy connections to Kafka cluster. Connect through SOCKS Proxy, HTTP Proxy or to cluster running in Kubernetes.
Go
366
Updated: 2 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
s
spark-perfby databricks
Performance tests for Apache Spark
Scala
366
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
a
akka-streams-exampleby inanna-malick
Scala
365
Updated: 4 y ago
License: No License (No License)
Support
Quality
Security
License
Reuse
t
tributaryby timkpaine
Streaming reactive and dataflow graphs in Python
Python
364
Updated: 3 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
S
SlimMessageBusby zarusz
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
C#
363
Updated: 2 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
D
Data-Engineering-with-Pythonby PacktPublishing
Data Engineering with Python, published by Packt
Python
361
Updated: 2 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
s
swarrotby swarrot
A lib to consume message from any Broker
PHP
359
Updated: 2 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
k
kafka-streams-vizby zz85
Kafka Streams Topology Sketch Diagram Visualization
JavaScript
356
Updated: 2 y ago
License: No License (No License)
Support
Quality
Security
License
Reuse
E
ECommerceRecommendSystemby ittqqzz
商品大数据实时推荐系统。前端:Vue + TypeScript + ElementUI,后端 Spring + Spark
Java
355
Updated: 2 y ago
License: No License (No License)
Support
Quality
Security
License
Reuse
d
docker-influxdb-grafanaby nicolargo
Docker-compose files for a simple InfluxDB + Grafana stack
Shell
354
Updated: 4 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
k
kminionby cloudhut
KMinion is a feature-rich Prometheus exporter for Apache Kafka written in Go. It is lightweight and highly configurable so that it will meet your requirements.
Go
353
Updated: 3 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
E
ELK-dockerby sqshq
Docker configuration for ELK monitoring stack with Curator and Beats data shippers support
Shell
352
Updated: 2 y ago
License: No License (No License)
Support
Quality
Security
License
Reuse
r
ratchetby dailyburn
A library for performing data pipeline / ETL tasks in Go.
Go
350
Updated: 4 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
s
scala-kafka-clientby cakesolutions
Scala helper modules for operating the Apache Kafka client library (0.9.x - 2.1.0)
Scala
349
Updated: 4 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
a
attic-apex-coreby apache
Mirror of Apache Apex core
Java
344
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
m
mocker-data-generatorby danibram
A simplified way to generate masive mock data based on a schema, using the awesome fake/random data generators like (FakerJs, ChanceJs, CasualJs and RandExpJs), all in one tool to generate your fake data for testing.
TypeScript
341
Updated: 4 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
H
HashtagCashtagby shafiab
My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggregates Twitter and US stock market data for user sentiment analysis using open source tools - Apache Kafka for data ingestions, Apache Spark & Spark Streaming for batch & real-time processing, Apache Cassandra f or storage, Flask, Bootstrap and HighCharts f or frontend.
Scala
341
Updated: 2 y ago
License: No License (No License)
Support
Quality
Security
License
Reuse
S
SpinalTapby airbnb
Change Data Capture (CDC) service
Java
340
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
k
kafka-lag-exporterby lightbend
Monitor Kafka Consumer Group Latency with Kafka Lag Exporter
Scala
340
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
A
Anno.Coreby duyanming
Anno 是一个微服务快速开发框架,底层通讯可以随意切换 grpc、thrift。自带服务发现、调用链追踪、Cron 调度、限流、事件总线、CQRS 、DDD、类似MVC的开发体验,插件化开发。 Anno is a microservices rapid development framework, the underlying communication can be arbitrary switch GRPC, thrift.Built-in service discovery, call chain tracking, Cron scheduling, current limiting, event bus, CQRS, DDD, similar MVC development experience, plug-in development.
C#
339
Updated: 2 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
s
scrapy-mongodbby sebdah
MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the items to MongoDB as soon as your spider finds data to extract.
Python
337
Updated: 4 y ago
License: Proprietary (Proprietary)
Support
Quality
Security
License
Reuse
k
kafka-security-managerby conduktor
Manage your Kafka ACL at scale
Scala
337
Updated: 2 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
n
noeqdby bmizerany
A fault-tolerant network service for meaningful GUID generation
Go
337
Updated: 4 y ago
License: No License (No License)
Support
Quality
Security
License
Reuse
s
seconds-killby daydreamdev
基于 Springboot + Redis + Kafka 的秒杀系统,乐观锁 + 缓存 + 限流 + 异步,TPS 从 500 优化到 3000
Java
336
Updated: 2 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
g
golang-distributed-filesystemby ligfx
HDFS-alike in Go. Written in 2014 to learn the language and get a job.
Go
336
Updated: 4 y ago
License: No License (No License)
Support
Quality
Security
License
Reuse
s
scala-kafkaby elodina
Quick up and running using Scala for Apache Kafka
Scala
335
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
s
sdk-javaby cloudevents
Java SDK for CloudEvents
Java
333
Updated: 2 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
M
MsSystem-BPM-ServiceAndWebAppsby wangmaosheng
.net core 微服务 权限系统+工作流系统
JavaScript
333
Updated: 4 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
a
api-gateway-demo-sign-javaby aliyun
aliyun api gateway request signature demo by java
Java
332
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
i
Support
Quality
Security
License
Reuse
t
tech-blogby yongxinz
我的个人技术博客(Python、Django、Docker、Go、Redis、ElasticSearch、Kafka、Linux)
Python
331
Updated: 2 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
s
synchby long2ice
Sync data from the other DB to ClickHouse(cluster)
Python
329
Updated: 2 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
a
amazon-kinesis-connectorsby amazon-archives
Java
329
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
s
sioby minio
Go implementation of the Data At Rest Encryption (DARE) format.
Go
329
Updated: 2 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
a
amazon-kinesis-connectorsby awslabs
Java
328
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
d
dyneinby airbnb
Airbnb's Open-source Distributed Delayed Job Queueing System
Java
328
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
a
amazon-kinesis-agentby awslabs
Continuously monitors a set of log files and sends new data to the Amazon Kinesis Stream and Amazon Kinesis Firehose in near-real-time.
Java
328
Updated: 2 y ago
License: Proprietary (Proprietary)
Support
Quality
Security
License
Reuse
N
Noahby lusis
Lightweight node/service registry inspired by Apache Zookeeper
Ruby
328
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
n
node-reportby nodejs
Delivers a human-readable diagnostic summary, written to file.
C++
328
Updated: 4 y ago
License: Proprietary (Proprietary)
Support
Quality
Security
License
Reuse
r
ratatoolby spotify
A tool for data sampling, data generation, and data diffing
Scala
328
Updated: 2 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
u
ud615by udacity
Course code for Scalable Microservices with Kubernetes
Go
327
Updated: 4 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
d
distributed_frameworkby ydf0509
pip install function_scheduling_distributed_framework,python通用分布式函数调度框架。python万能超高并发神器,改成funboost框架名字,停止更新,只更新funboost框架。
Python
321
Updated: 2 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
g
gogen-avroby actgardner
Generate Go code to serialize and deserialize Avro schemas
Go
321
Updated: 2 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
m
my-momentsby amrkhaledccd
Instagram Clone - Cloning Instagram for learning purpose
Java
320
Updated: 2 y ago
License: No License (No License)
Support
Quality
Security
License
Reuse
b
big-data-codeby Big-Data-Manning
Source code for Big Data: Principles and best practices of scalable realtime data systems
Java
319
Updated: 4 y ago
License: No License (No License)
Support
Quality
Security
License
Reuse
c
codo-cmdbby opendevops-cn
基于Tornado实现的一套资产管理系统、支持AWS、阿里云、腾讯云、华为云自动拉取资产信息等
Python
318
Updated: 2 y ago
License: Strong Copyleft (GPL-3.0)
Support
Quality
Security
License
Reuse
a
aliware-kafka-demosby AliwareMQ
提供各种客户端接入阿里云 消息队列 Kafka 的demo工程
Java
317
Updated: 3 y ago
License: No License (No License)
Support
Quality
Security
License
Reuse
c
coreby gazette
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
Go
317
Updated: 3 y ago
License: Permissive (MIT)
Support
Quality
Security
License
Reuse
a
aegisthusby Netflix
A Bulk Data Pipeline out of Cassandra
Java
316
Updated: 4 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
s
spring-cloud-stream-binder-kafkaby spring-cloud
Spring Cloud Stream binders for Apache Kafka and Kafka Streams
Java
316
Updated: 2 y ago
License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse