kafka

There are 244 repositories under kafka topic.

apache / kafka
Mirror of Apache Kafka
kafka scala
Language:Java 29621
DataTalksClub / data-engineering-zoomcamp
Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering.
data-engineering dbt docker kafka kestra spark
Language:Jupyter Notebook 29341
pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
batch-processing data-analytics data-pipelines data-processing dataflow etl etl-framework iot-analytics kafka machine-learning-algorithms pathway python real-time rust stream-processing streaming time-series-analysis
Language:Python 23366
yudaocode / SpringBoot-Labs
一个涵盖六个专栏：Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖，右上角来个 Star，感恩 1024
activemq dubbo kafka rabbitmq rocketmq spring-boot spring-cloud spring-cloud-alibaba
Language:Java 19449
thingsboard
thingsboard / thingsboard
Open-source IoT Platform - Device management, data collection, processing and visualization.
cloud coap dashboard iot iot-analytics iot-platform iot-solutions java kafka lwm2m microservices middleware mqtt netty platform snmp thingsboard visualization websockets widgets
Language:Java 18380
heibaiying / BigData-Notes
大数据入门指南 :star:
hadoop hdfs yarn mapreduce hive spark storm hbase scala kafka zookeeper flume azkaban sqoop phoenix bigdata big-data
Language:Java 16242
influxdata / telegraf
Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
gnmi golang influxdb json kafka logs metrics modbus monitoring mqtt opcua telegraf time-series windows-eventlog windows-management-instrumentation xpath
Language:Go 15379
flink-learning
zhisheng17 / flink-learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
clickhouse elasticsearch flink hbase influxdb kafka loki mysql opentsdb rabbitmq redis rocketmq spark stream-processing streaming
Language:Java 14686
aalansehaiyang / technology-talk
【大厂面试专栏】一份Java程序员需要的技术指南，这里有面试题、系统架构、职场锦囊、主流中间件等，让你成为更牛的自己！
dubbo es6 git hbase java kafka mycat spark spring springboot
14365
sogou / workflow
C++ Parallel Computing and Asynchronous Networking Framework
consul dag http kafka mysql redis sogou tasking
Language:C++ 13584
yahoo / CMAK
CMAK is a tool for managing Apache Kafka clusters
big-data cluster-management kafka scala
Language:Scala 11881
IBM / sarama
Sarama is a Go library for Apache Kafka.
go kafka kafka-client
Language:Go 11832
kubeshark
kubeshark / kubeshark
The API traffic analyzer for Kubernetes providing real-time K8s protocol-level visibility, capturing and monitoring all traffic and payloads going in, out and across containers, pods, nodes and clusters. Inspired by Wireshark, purposely built for Kubernetes
kubernetes microservices golang rest grpc amqp kafka redis go microservice microservices-application devops devops-tools sniffer observability wireshark cloud-native docker forensics incident-response
Language:Go 11237
debezium / debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
apache-kafka cdc change-data-capture database debezium event-streaming kafka kafka-connect kafka-producer
Language:Java 11156
kafka-ui
provectus / kafka-ui
Open-Source Web UI for Apache Kafka Management
apache-kafka big-data cluster-management event-streaming hacktoberfest kafka kafka-brokers kafka-client kafka-cluster kafka-connect kafka-manager kafka-producer kafka-streams kafka-ui opensource streaming-data streams web-ui
Language:Java 10415
redpanda
redpanda-data / redpanda
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
containers cpp event-driven go kafka kubernetes microservices realtime redpanda seastar storage-engine stream-processing streaming
Language:C++ 10090
wangzhiwubigdata / God-Of-BigData
专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
azkaban bigdata flink flume hadoop hbase hdfs hive kafka spark zookeeper
9986
connect
redpanda-data / connect
Fancy stream processing made operationally mundane
message-queue stream-processing streaming-data message-bus logs stream-processor cqrs event-sourcing go golang kafka amqp rabbitmq nats etl data-engineering data-ops
Language:Go 8261
watermill
ThreeDotsLabs / watermill
Building event-driven applications the easy way in Go.
cqrs event-driven event-sourcing events go golang kafka nats rabbitmq reactive sagas stream-processing watermill
Language:Go 8168
segmentio / kafka-go
Kafka library in Go
consumer go golang golang-library golang-native kafka kafka-client producer segment
Language:Go 7834
Graylog2 / graylog2-server
Free and open log management
log-analysis log-collector log-viewer logging logging-server siem secure-logging security gelf syslog graylog kafka amqp log-management hacktoberfest
Language:Java 7580
risingwave
risingwavelabs / risingwave
Stream processing and management platform.
data-engineering database kafka materialized-view postgresql rust stream-processing
Language:Rust 7508
KnowStreaming
didi / KnowStreaming
一站式云原生实时流数据平台，通过0侵入、插件化构建企业级Kafka服务，极大降低操作、存储和管理实时流数据门槛
cluster-manager clustermanager kafka kafkamanager kafkamonitor knowstreaming logikm multi-cluster multi-cluster-management
Language:Java 7049
dotnetcore / CAP
Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern
distributed-transactions eventbus kafka microservices outbox-pattern rabbitmq service-bus
Language:C# 6803
robinhood / faust
Python Stream Processing
asyncio distributed-systems kafka kafka-streams python stream-processing
Language:Python 6773
HariSekhon / DevOps-Bash-tools
1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..
api aws bash ci cloudera devops docker gcp git github hacktoberfest hadoop jenkins kafka kubernetes linux mysql perl postgresql terraform
Language:Shell 6587
CoderLeixiaoshuai / java-eight-part
『Java八股文』Java面试套路，Java进阶学习，打破内卷拿大厂Offer，升职加薪！
java juc redis spring kafka mysql
Language:Java 6339
apache / flink-cdc
Flink CDC is a streaming data integration tool
batch cdc change-data-capture data-integration data-pipeline distributed elt etl flink kafka mysql paimon postgresql real-time schema-evolution
Language:Java 5985
materialize
MaterializeInc / materialize
Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.
data-store database distributed-systems kafka materialized-view operational-data-store postgresql postgresql-dialect rust sql stream-processing streaming streaming-data
Language:Rust 5900
obsidiandynamics / kafdrop
Kafka Web UI
kafka kubernetes docker consumer-group consumer-producer pub-sub event-sourcing event-streaming kafka-ui kafka-utils kafka-tools zookeeper web-ui topic
Language:Java 5740
dpkp / kafka-python
Python client for Apache Kafka
kafka python
Language:Python 5696
opengoofy / hippo4j
📌 异步线程池框架，支持线程池动态变更&监控&报警，无需修改代码轻松引入。Asynchronous thread pool framework, support Thread Pool Dynamic Change & monitoring & Alarm, no need to modify the code easily introduced.
blocking-queue dynamic dynamic-threadpool java kafka monitor resizable rocketmq springboot thread-pool
Language:Java 5688
rfyiamcool / share_ppt
🚗 个人做过的技术分享... ( topic: 高性能架构, 中间件原理实践，云原生，Golang 等)
etcd golang kafka keynote kubernetes mysql ppt python
5598
strimzi-kafka-operator
strimzi / strimzi-kafka-operator
Apache Kafka® running on Kubernetes
data-stream data-streaming data-streams hacktoberfest kafka kafka-connect kafka-streams kubernetes kubernetes-controller kubernetes-operator messaging openshift
Language:Java 5134
travisjeffery / jocko
Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
distributed-systems go kafka messaging queue streaming
Language:Go 4968
2227324689 / gpmall
【咕泡学院实战项目】-基于SpringBoot+Dubbo构建的电商平台-微服务架构、商城、电商、微服务、高并发、kafka、Elasticsearch
canal dubbo elasticsearch elk java kafka nacos sentinel springboot springcloud-alibaba zookeeper
Language:Java 4948

kafka

apache / kafka

DataTalksClub / data-engineering-zoomcamp

pathwaycom / pathway

yudaocode / SpringBoot-Labs

thingsboard / thingsboard

heibaiying / BigData-Notes

influxdata / telegraf

zhisheng17 / flink-learning

aalansehaiyang / technology-talk

sogou / workflow

yahoo / CMAK

IBM / sarama

kubeshark / kubeshark

debezium / debezium

provectus / kafka-ui

redpanda-data / redpanda

wangzhiwubigdata / God-Of-BigData

redpanda-data / connect

ThreeDotsLabs / watermill

segmentio / kafka-go

Graylog2 / graylog2-server

risingwavelabs / risingwave

didi / KnowStreaming

dotnetcore / CAP

robinhood / faust

HariSekhon / DevOps-Bash-tools

CoderLeixiaoshuai / java-eight-part

apache / flink-cdc

MaterializeInc / materialize

obsidiandynamics / kafdrop

dpkp / kafka-python

opengoofy / hippo4j

rfyiamcool / share_ppt

strimzi / strimzi-kafka-operator

travisjeffery / jocko

2227324689 / gpmall