apache-kafka

There are 26 repositories under apache-kafka topic.

• debezium / debezium

  Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

  change-data-capturekafka-connectapache-kafkadebeziumcdcdatabasekafkakafka-producerevent-streaming
  Language:Java 9854
• kafka-ui

  provectus / kafka-ui

  Open-Source Web UI for Apache Kafka Management

  kafka-uikafka-brokerskafkakafka-streamskafka-clientopensourcekafka-connectkafka-producerstreamsbig-dataapache-kafkacluster-managementweb-uikafka-managerkafka-clusterstreaming-dataevent-streaminghacktoberfest
  Language:Java 8458

• confluentinc / librdkafka

  The Apache Kafka C/C++ library

  apache-kafkacc-plus-plusconsumerhigh-performancekafkakafka-consumerkafka-producerlibrdkafka
  Language:C 7276
• console

  redpanda-data / console

  Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.

  apache-kafkadataopsreacttypescriptkafka-uikafka-guiweb-uigokafka
  Language:Go 3594

• karafka / karafka

  Ruby and Rails efficient Kafka processing framework

  karafka-frameworkkafkakafka-clientkafka-clientskafka-producerkafka-consumerapache-kafkarubyrailskafka-rubyruby-on-railsruby-libraryrubyonrailseventsactive-jobactivejob-backendbackground-jobskafka-managerkafka-monitoropensource
  Language:Ruby 1968

• OryxProject / oryx

  Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

  apache-kafkaapache-sparkclouderajavakafkalambda-architecturemachine-learningoryx
  Language:Java 1786

• Parsely / pykafka

  Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

  kafkapythonc-extensionapache-kafka
  Language:Python 1116

• fgeller / kt

  Kafka command line tool that likes JSON

  kafkajsongolangcliapache-kafka
  Language:Go 940

• confluentinc / cp-all-in-one

  docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

  quickstartapache-kafkakafkaconfluentconfluent-platformdocker-composekraft
  Language:Python 878

• confluentinc / cp-helm-charts

  The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.

  kubernetesstatefulsetszookeeperapache-kafkahelm-chartshelmkafka-connectkafka-rest-proxyksqlksql-server
  Language:Mustache 782

• deviceinsight / kafkactl

  Command Line Tool for managing Apache Kafka

  apache-kafkaavroclikafkagolangzshfish
  Language:Go 748

• miguno / kafka-storm-starter

  [PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

  apache-kafkakafkaapache-stormstormsparkapache-sparkscalaintegrationavroapache-avro
  Language:Scala 727

• gvolpe / trading

  💱 Trading application written in Scala 3 that showcases an Event-Driven Architecture (EDA) and Functional Programming (FP)

  event-driven-architecturefunctional-programmingfpedafs2cats-effectapache-pulsarapache-kafkaelm-langelm-architectureelmweb-socketswebsocketsgrafanaprometheusopen-tracingscalascala3
  Language:Scala 603

• Farfetch / kafkaflow

  Apache Kafka .NET Framework to create applications simple to use and extend.

  apache-kafkac-sharpconsumercsharpdotnetdotnetcorefarfetchhacktoberfestkafkakafka-clientkafka-clientskaflaflowmiddlewaresnugetworkers
  Language:C# 575

• mfontanini / cppkafka

  Modern C++ Apache Kafka client library (wrapper for librdkafka)

  kafkardkafkalibrdkafkaapache-kafka
  Language:C++ 575

• joowani / kq

  Kafka-based Job Queue for Python

  apache-kafkajob-queuekafkakafka-clientkafka-consumerkafka-producerproducer-consumerpythonpython3queueingworker-queue
  Language:Python 569

• infoslack / awesome-kafka

  A list about Apache Kafka

  kafkastreaming-datadata-pipelinestream-processingapache-kafkaapache-sparkkafka-streamsinfrastructuredata-processing
  565

• artie-labs / transfer

  Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.

  snowflakecdcchange-data-capturegolangbigquerykafkaapache-kafkadata-integrationdata-pipelinesdatabasedebeziumeltredshift
  Language:Go 527
• quix-streams

  quixio / quix-streams

  Quix Streams - A library for data streaming and Python Stream Processing

  apache-kafkakafkapythonstream-processing
  Language:Python 481

• confluentinc / kafka-connect-hdfs

  Kafka Connect HDFS connector

  confluentkafkaapache-kafkakafka-connect-hdfskafka-connectorhadoophdfsbig-datastreaming
  Language:Java 474

• rjurney / Agile_Data_Code_2

  Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

  data-syndromedatadata-scienceanalyticsapache-sparkapache-kafkakafkasparkpredictive-analyticsmachine-learningmachine-learning-algorithmsairflowpythonpython-3python3amazon-ec2agile-dataagile-data-sciencevagrantamazon-web-services
  Language:Jupyter Notebook 456

• streamnative / kop

  Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

  apache-pulsarapache-kafkapubsubevent-streamingkafka-on-pulsarkoppub-subdotnetpulsarkafka
  Language:Java 446

• zarusz / SlimMessageBus

  Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

  message-busmessagingazure-event-hubspub-subrequest-responsec-sharpazure-service-busredisapache-kafkakafkabusazureavrorabbitmqdddmqttdotnet
  Language:C# 433

• oslabs-beta / Kafka-Sprout

  :rocket: Web GUI for Kafka Cluster Management

  apacheapache-kafkadeveloper-toolsjavakafkaspring-boottypescript
  Language:Java 431

• YunaiV / incubator-rocketmq

  带中文代码注释 Mirror of Apache RocketMQ 源码解析：http://www.iocoder.cn/categories/RocketMQ/?github

  rocketmqapache-rocketmqmetaqnotifytddlmetamorphosisapache-kafka
  Language:Java 363

• kcctl / kcctl

  A modern and intuitive command line client for Kafka Connect

  apache-kafkakafka-connectcli
  Language:Java 350

• miguno / wirbelsturm

  [PROJECT IS NO LONGER MAINTAINED] Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

  vagrantpuppetkafkaapache-kafkastormapache-stormsparkapache-spark
  Language:Shell 331

• karafka / rdkafka-ruby

  Modern and performant Kafka client library for Ruby based on librdkafka

  rubykafkalibrdkafkaapache-kafkaapache-kafka-consumerapache-kafka-producer
  Language:Ruby 320

• raystack / firehose

  Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

  kafkasinkstreamingfirehosedataopsbigquerypostgresqlinfluxdbprometheusapache-kafka
  Language:Java 313

• confluentinc / kafka-tutorials

  Tutorials and Recipes for Apache Kafka

  kafka-tutorialsksqldbkafkakafka-streamsapache-kafkastream-processing
  Language:Java 296
• kafka-ui

  kafbat / kafka-ui

  Open-Source Web UI for managing Apache Kafka clusters

  apache-kafkabig-datacluster-managementevent-streaminghacktoberfestkafkakafka-brokerskafka-clientkafka-clusterkafka-connectkafka-managerkafka-producerkafka-streamskafka-uiopensourcestreaming-datastreamsweb-uifoss
  Language:Java 292

• raystack / dagger

  Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

  stream-processingframeworkapache-flinkapache-kafkareal-time-processingreal-time-analyticsprometheusinfluxdbdataops
  Language:Java 254
• kouncil

  Consdata / kouncil

  Powerful dashboard for your Kafka. Monitor status, manage groups, topics, send messages and diagnose problems. All in one user friendly web dashboard.

  apache-kafkadashboarddockerguikafkakafka-companionkafka-guikafka-toolskafka-uikafka-utilskouncilopen-sourcetopicsui
  Language:TypeScript 247

• karafka / waterdrop

  Standalone Karafka library for producing Kafka messages

  waterdropruby-kafkakarafka-frameworkkarafkakarafka-applicationkafkaapache-kafkarubygemsrubygemrubyapache-kafka-producer
  Language:Ruby 241

• Azure / azure-event-hubs-for-kafka

  Azure Event Hubs for Apache Kafka Ecosystems

  azureeventhubsevent-hubsmicrosoftmessagingapache-kafkaapachekafka
  Language:Java 219
• go-notify

  Harry-027 / go-notify

  An email automation solution, written in Golang.

  gogolanggofibercobraapache-kafkaredispostgresk6prometheusgrafana
  Language:Go 189