kafka-streaming

There are 1 repository under kafka-streaming topic.

• microsoft / Mobius

  C# and F# language binding and extensions to Apache Spark

  sparkapache-sparkrdddataframedstreamdatasetstreamingcsharpmobiuskafka-streamingspark-streamingfsharpbigdatamapreduceeventhubsnear-real-time
  Language:C# 940

• kishlayjeet / Stock-Market-Real-Time-Data-Pipeline-with-Apache-Kafka-and-Cassandra

  A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.

  apache-kafkacassandrakafkapipelinepythonstock-marketstock-market-data-pipelineawsaws-ec2data-engineeringdata-engineering-pipelinedata-pipelineec2ec2-instanceetletl-pipelinekafka-streamingkafka-streamsreal-timereal-time-data-pipeline
  Language:Python 26

• felipegutierrez / explore-kafka

  This project implements an end-to-end pipeline for batch to stream processing using Kafka on Docker images. Besides that, there are exercises for a full course in Kafka.

  kafkakafka-streamingjavamockitokafka-schema-registrykafka-clusterkafka-connectorsjacoco
  Language:Java 6

• IBM / ibm-streams-with-kafka

  Build a Kafka streaming app using IBM Streams

  ibm-cloudibm-streamskafkaibm-cloud-pakjupyter-notebookpython3stream-processingapache-kafkastreams-flowskafka-streaming
  Language:Jupyter Notebook 6

• Thomas-George-T / Kafka-Tweet-Stream

  Stream real time Tweets of current affairs like covid-19 using Kafka 2.0.0 high throughput producer & consumer into Elasticsearch using safe, idempotent and compression configurations. Aggregate the data and use it for further analytics.

  kafka-producerkafkatwittertwitter-apitwitter-streaming-apikafka-streamingkafka-twitter-streamingkafka-console-consumerthroughput-producerelasticsearchbonsaikafka-consumerkafka-serverstwitterproducercovid-19zookeepercoronavirus-real-timecoronaviruscoronavirus-dataset
  Language:Java 6

• tashi-2004 / FMA-A-Dataset-For-Music-Analysis

  Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features, store them in MongoDB, and process the data with Apache Spark. A web interface is also included.

  htmlkafkakafka-consumerkafka-producerkafka-streaminglinuxmongodbmongodb-compasspython3sparkubuntuweb-application
  Language:Python 4

• chandnii7 / Big-Data-Processing-Pipeline

  A pipeline that consumes twitter data to extract meaningful insights about a variety of topics using the following technologies: twitter API, Kafka, MongoDB, and Tableau.

  twitter-apikafkakafka-producerkafka-consumerkafka-streamingzookeepermongodbtableaubig-databig-data-processingdata-processing-pipelinesdata-analyticsnosql-databasedata-visualization
  Language:Python 3

• gerardodavidlopezcastillo / GrafanaStepFunctionsSNS_Public

  Data streaming project with Apache Druid & Grafana: Real-time data processing, alerts, integration with AWS. It uses a combination of technologies and services, including Confluent-Kafka, Apache Druid, AWS SNS, EC2, Athena, S3, Glue and EventBridge, StepFunctions. Contribute to this powerful solution!

  apache-druidaws-athenaaws-ec2aws-eventbridgeaws-glueaws-s3aws-snsaws-step-functionsgrafanakafka-streamingwsl-ubuntu
  Language:Jupyter Notebook 2

• mallory-jpg / kafka-fraud

  Streaming fraud detection system

  kafkakafka-streamingpython
  Language:Python 2

• pedrodeoliveira / kafka-streaming-tests

  Kafka streaming performance tests.

  kafka-streamingpythonk8sfaustjavakafka-streamsgokacloudbuild
  Language:Python 2

• hanchiang / apache-kafka-real-time-stream-processing

  Learn kafka real-time stream processing

  kafkakafka-streaming
  Language:Java 1

• ManikHossain08 / Spark-ETL-Data-Pipeline-using-SparkStreaming-HDFS-Kafka-Hive

  The objectives of this project are to get experience of coding with: Spark, Spark SQL, Spark Streaming, Kafka, Scala and functional programming

  kafkahdfshivespark-streamingkafka-streamingscalascala-spark
  Language:Scala 1

• s3ni0r / kafka-streams-base

  Base project for kafka-streams development and testing

  scalakafka-streamingkafkaintegration-testingsbt
  Language:Scala 1

• ssamparn / spring-microservices-assorted

  The purpose of this project is to learn, develop and explore microservices using spring boot, spring cloud, event streaming

  kafka-streamingreactive-kafka-programmingreactive-programmingreactive-streamsspring-bootwebflux
  Language:Java 1

• MartinKalema / confluent-kafka-data-streaming

  Consumer Producer Components

  kafkakafka-consumerkafka-producerschema-registryflat-filekafka-streaming
  Language:Python 0

• NorthBrains / dashboard-1

  An interactive dashboard simulating live sales and warehouse data for the company.

  cassandracontainersdashboarddata-engineeringdata-sciencedockerdocker-composekafkakafka-streamingplotlyplotly-dashsparkspark-streamingstreaming
  Language:Python 0

• QuantumFuturist / datastack-kafka

  This repository is a comprehensive guide and toolkit for anyone looking to understand and implement data streaming solutions using Apache Kafka.

  kafka-streamingapache-kafkabig-datakafkakafka-connectksqldbstreaming
  0

• sinhaGuild / ml-streming-kafka-cdc

  Machine Learning (Streaming) with KAFKA, Debezium and BentoML Service.

  bentomldebezium-connectordockerdocker-composekafkakafka-streamingmachine-learningpostgresql-databasepythondata-science
  Language:Python 0

• felipexw / getting-started-kafka

  kafkakafka-streamingjava
  Language:Java

• saLeox / Kafka-Springboot-Integration

  Kafka integration in Springboot, including producer, consumer, streaming, and interactive query of Ktable.

  springboot-kafkakafka-streaminginteractive-queries
  Language:Java

• saLeox / Lambda-Streaming-HousePricePredict

  Using kafka streaming to implement the streaming ETL job, append data onto GCP Big Query after formatting.

  kafka-streamingbig-queryktableskafka-windows
  Language:Java

• TechnocratSid / spring-kafka

  spring-kafkaspring-bootkafka-streaming
  Language:Java

• TheDataArtisanDev / kafka-streams-processor

  This repository contains the code to read the streaming kafka data and perform various streaming operations

  javakafkakafka-streaming
  Language:Java

• ustari28 / javaspark

  Tests with Spark local, kafka streaming and socket streaming

  kafka-streamingspark-streamingjava8
  Language:Java

• wjc-van-es / ps-eda-kafka-streams

  Example from Designing Event-driven Applications Using Apache Kafka Ecosystem By Bogdan Sucaciu m 5

  apache-kafkaavroconfluent-platformconfluent-schema-registrycp-community-componentsdocker-composekafka-streamingksqldbksqldb-clipluralsight-course
  Language:Java