kafka

There are 257 repositories under kafka topic.

pathway
pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
batch-processing data-analytics data-pipelines data-processing dataflow etl etl-framework iot-analytics kafka machine-learning-algorithms pathway python real-time rust stream-processing streaming time-series-analysis
Language:Python 49497
DataTalksClub / data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼
course data-engineering dbt docker free kafka kestra spark
Language:Jupyter Notebook 33428
apache / kafka
Mirror of Apache Kafka
kafka scala
Language:Java 31280
thingsboard
thingsboard / thingsboard
Open-source IoT Platform - Device management, data collection, processing and visualization.
cloud coap dashboard iot iot-analytics iot-platform iot-solutions java kafka lwm2m microservices middleware mqtt netty platform snmp thingsboard visualization websockets widgets
Language:Java 20391
yudaocode / SpringBoot-Labs
一个涵盖六个专栏：Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖，右上角来个 Star，感恩 1024
spring-boot spring-cloud spring-cloud-alibaba dubbo rocketmq rabbitmq kafka activemq
Language:Java 19948
heibaiying / BigData-Notes
大数据入门指南 :star:
hadoop hdfs yarn mapreduce hive spark storm hbase scala kafka zookeeper flume azkaban sqoop phoenix bigdata big-data
Language:Java 16741
influxdata / telegraf
Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
gnmi golang hacktoberfest influxdb json kafka logs metrics modbus monitoring mqtt opcua telegraf time-series windows-eventlog windows-management-instrumentation xpath
Language:Go 16458
flink-learning
zhisheng17 / flink-learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
flink kafka elasticsearch spark redis mysql rocketmq hbase rabbitmq stream-processing streaming clickhouse loki influxdb opentsdb
Language:Java 14973
aalansehaiyang / technology-talk
【大厂面试专栏】一份Java程序员需要的技术指南，这里有面试题、系统架构、职场锦囊、主流中间件等，让你成为更牛的自己！
dubbo es6 git hbase java kafka mycat spark spring springboot
14655
sogou / workflow
C++ Parallel Computing and Asynchronous Networking Framework
consul dag http kafka mysql redis sogou tasking
Language:C++ 14161
IBM / sarama
Sarama is a Go library for Apache Kafka.
kafka kafka-client go
Language:Go 12296
debezium / debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
apache-kafka cdc change-data-capture data-pipeline database debezium event-streaming hacktoberfest kafka kafka-connect kafka-producer
Language:Java 12053
yahoo / CMAK
CMAK is a tool for managing Apache Kafka clusters
big-data cluster-management kafka scala
Language:Scala 11937
kafka-ui
provectus / kafka-ui
Open-Source Web UI for Apache Kafka Management
kafka-ui kafka-brokers kafka kafka-streams kafka-client opensource kafka-connect kafka-producer streams big-data apache-kafka cluster-management web-ui kafka-manager kafka-cluster streaming-data event-streaming hacktoberfest
Language:Java 11565
kubeshark
kubeshark / kubeshark
The API traffic analyzer for Kubernetes providing real-time K8s protocol-level visibility, capturing and monitoring all traffic and payloads going in, out and across containers, pods, nodes and clusters. Inspired by Wireshark, purposely built for Kubernetes
kubernetes microservices golang rest grpc amqp kafka redis go microservice microservices-application devops devops-tools sniffer observability wireshark cloud-native docker forensics incident-response
Language:Go 11548
redpanda
redpanda-data / redpanda
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
containers cpp event-driven go kafka kubernetes microservices realtime redpanda seastar storage-engine stream-processing streaming
Language:C++ 11234
wangzhiwubigdata / God-Of-BigData
专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
flink spark hadoop hdfs hive hbase kafka zookeeper bigdata flume azkaban
10340
watermill
ThreeDotsLabs / watermill
Building event-driven applications the easy way in Go.
watermill event-driven event-sourcing sagas events stream-processing reactive go golang rabbitmq kafka cqrs nats
Language:Go 9217
risingwave
risingwavelabs / risingwave
Streaming data platform. Real-time stream processing, low-latency serving, and Iceberg table management.
database stream-processing rust postgresql kafka materialized-view data-engineering apache-iceberg etl-pipeline
Language:Rust 8505
connect
redpanda-data / connect
Fancy stream processing made operationally mundane
amqp cqrs data-engineering data-ops etl event-sourcing go golang kafka logs message-bus message-queue nats rabbitmq stream-processing stream-processor streaming-data
Language:Go 8497
segmentio / kafka-go
Kafka library in Go
consumer go golang golang-library golang-native kafka kafka-client producer segment
Language:Go 8356
Graylog2 / graylog2-server
Free and open log management
log-analysis log-collector log-viewer logging logging-server siem secure-logging security gelf syslog graylog kafka amqp log-management hacktoberfest
Language:Java 7868
automq
AutoMQ / automq
AutoMQ is a diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
apache-kafka cloud cloud-first cloud-native diskless kafka messaging minio minio-storage object-storage s3 serverless streaming
Language:Java 7664
HariSekhon / DevOps-Bash-tools
1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..
api aws bash ci cloudera devops docker gcp git github hacktoberfest hadoop jenkins kafka kubernetes linux mysql perl postgresql terraform
Language:Shell 7211
KnowStreaming
didi / KnowStreaming
一站式云原生实时流数据平台，通过0侵入、插件化构建企业级Kafka服务，极大降低操作、存储和管理实时流数据门槛
kafka kafkamonitor kafkamanager logikm cluster-manager multi-cluster clustermanager multi-cluster-management knowstreaming
Language:Java 7157
dotnetcore / CAP
Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern
kafka rabbitmq distributed-transactions outbox-pattern eventbus microservices service-bus
Language:C# 7006
CoderLeixiaoshuai / java-eight-part
『Java八股文』Java面试套路，Java进阶学习，打破内卷拿大厂Offer，升职加薪！
java juc kafka mysql redis spring
Language:Java 6877
robinhood / faust
Python Stream Processing
kafka-streams kafka python asyncio distributed-systems stream-processing
Language:Python 6823
apache / flink-cdc
Flink CDC is a streaming data integration tool
batch cdc change-data-capture data-integration data-pipeline distributed elt etl flink kafka mysql paimon postgresql real-time schema-evolution
Language:Java 6261
materialize
MaterializeInc / materialize
The live data layer for apps and AI agents Create up-to-the-second views into your business, just using SQL
rust database sql streaming kafka distributed-systems postgresql-dialect materialized-view stream-processing postgresql streaming-data operational-data-store data-store cdc data-mesh mysql sql-server
Language:Rust 6159
obsidiandynamics / kafdrop
Kafka Web UI
consumer-group consumer-producer docker event-sourcing event-streaming kafka kafka-tools kafka-ui kafka-utils kubernetes pub-sub topic web-ui zookeeper
Language:Java 6034
opengoofy / hippo4j
📌 异步线程池框架，支持线程池动态变更&监控&报警，无需修改代码轻松引入。Asynchronous thread pool framework, support Thread Pool Dynamic Change & monitoring & Alarm, no need to modify the code easily introduced.
java thread-pool dynamic monitor dynamic-threadpool resizable blocking-queue springboot rocketmq kafka
Language:Java 5930
dpkp / kafka-python
Python client for Apache Kafka
kafka python
Language:Python 5848
rfyiamcool / share_ppt
🚗 个人做过的技术分享... ( topic: 高性能架构, 中间件原理实践，云原生，Golang 等)
ppt python golang keynote etcd kafka kubernetes mysql
5698
strimzi-kafka-operator
strimzi / strimzi-kafka-operator
Apache Kafka® running on Kubernetes
kafka kubernetes openshift messaging kafka-connect kafka-streams data-streaming data-stream data-streams kubernetes-operator kubernetes-controller hacktoberfest
Language:Java 5536
2227324689 / gpmall
【咕泡学院实战项目】-基于SpringBoot+Dubbo构建的电商平台-微服务架构、商城、电商、微服务、高并发、kafka、Elasticsearch
kafka dubbo springboot zookeeper nacos springcloud-alibaba sentinel elasticsearch canal elk java
Language:Java 5008

kafka

pathwaycom / pathway

DataTalksClub / data-engineering-zoomcamp

apache / kafka

thingsboard / thingsboard

yudaocode / SpringBoot-Labs

heibaiying / BigData-Notes

influxdata / telegraf

zhisheng17 / flink-learning

aalansehaiyang / technology-talk

sogou / workflow

IBM / sarama

debezium / debezium

yahoo / CMAK

provectus / kafka-ui

kubeshark / kubeshark

redpanda-data / redpanda

wangzhiwubigdata / God-Of-BigData

ThreeDotsLabs / watermill

risingwavelabs / risingwave

redpanda-data / connect

segmentio / kafka-go

Graylog2 / graylog2-server

AutoMQ / automq

HariSekhon / DevOps-Bash-tools

didi / KnowStreaming

dotnetcore / CAP

CoderLeixiaoshuai / java-eight-part

robinhood / faust

apache / flink-cdc

MaterializeInc / materialize

obsidiandynamics / kafdrop

opengoofy / hippo4j

dpkp / kafka-python

rfyiamcool / share_ppt

strimzi / strimzi-kafka-operator

2227324689 / gpmall