data-streaming

There are 3 repositories under data-streaming topic.

• strimzi-kafka-operator

  strimzi / strimzi-kafka-operator

  Apache Kafka® running on Kubernetes

  kafkakubernetesopenshiftdockermessagingenmassekafka-connectkafka-streamsdata-streamingdata-streamdata-streamskubernetes-operatorkubernetes-controllerhacktoberfest
  Language:Java 4448
• memphis

  memphisdev / memphis

  Memphis.dev is a highly scalable and effortless data streaming platform

  datadata-engineeringdata-pipelinedata-stream-processingdata-streamingenrichmentgolangkubernetesmessage-brokermessage-busmessage-queuemessaging-queuemicroservicesschema-registry
  Language:Go 3145

• apache / inlong

  Apache InLong - a one-stop, full-scenario integration framework for massive data

  inlongone-stop-servicedata-streamingevent-streamingframeworkmassive-data-integrationfull-scenario-service
  Language:Java 1296

• linkedin / brooklin

  An extensible distributed system for reliable nearline data streaming at scale

  distributed-systemsdata-streamingscalabilitykafka-mirror-makerkafkachange-data-capturejavalinkedin
  Language:Java 888
• nussknacker

  TouK / nussknacker

  Low-code tool for automating actions on real time data | Stream processing for the users.

  flinkflink-kafkaapache-flinkguitoukreal-timedecision-makingkafkascalabig-datalow-codestreaminglowcodestream-processingautomationdata-streamingdecision-enginedecisioningrules-engine
  Language:Scala 603

• getindata / flink-http-connector

  Http Connector for Apache Flink. Provides sources and sinks for Datastream , Table and SQL APIs.

  flinkflink-sqlflink-stream-processingjavadata-streaming
  Language:Java 116

• DagsHub / client

  DagsHub client libraries

  machine-learningdata-sciencemachinelearningdvcpytorchkerastensorflowpythonhacktoberfesthacktoberfest2023aidatadata-streamingmlops
  Language:Python 90

• getindata / dbt-flink-adapter

  Adapter for dbt that executes dbt pipelines on Apache Flink

  apache-flinkdata-streamingdbtstreaming-analytics
  Language:Python 66

• eserie / wax-ml

  A Python library for machine-learning and feedback loops on streaming data

  data-streamingjaxmachine-learningpandaspythonreinforcement-learningtime-seriesxarray
  Language:Python 58

• pravega / pravega-samples

  Sample Applications for Pravega.

  data-streamingpravegasample-appstreaming-data
  Language:Java 54

• build-on-aws / building-apache-kafka-connectors

  Sample code that shows the important aspects of developing custom connectors for Kafka Connect. It provides the resources for building, deploying, and running the code on-premises using Docker, as well as running the code in the cloud.

  amazon-mskamazon-msk-connectapache-kafkadata-streamingjavakafka-connectkafka-connectorterraform
  Language:Java 39

• strimzi / strimzi-canary

  Strimzi canary

  kuberneteskafkaopenshiftmessagingdata-streaminghacktoberfest
  Language:Go 39

• KentHsu / Udacity-Data-Streaming-Nanodegree

  Udacity Data Streaming Nanodegree Program

  data-streamingapache-kafkafaust-applicationksqlkafka-connectkafka-rest-proxyspark-streaming
  Language:Python 21

• marian-nmt / sotastream

  A library for data streaming and augmentation

  data-augmentationdata-streamingmachine-learningpretraining
  Language:Python 20

• jaehyeon-kim / flink-demos

  Apache Flink (Pyflink) and Related Projects

  awsdata-streamingdockerdocker-composeflinkkafkakinesis-data-analyticspyflinkpythonreal-time-analytics
  Language:Python 10

• ppatierno / kafka-hybrid-iot

  Apache Kafka for the Hybrid IoT

  apache-kafkaiotinternet-of-thingsmessagingamqpapache-camelvertxiot-applicationiot-cloudkafka-streamsdata-streamingdata-stream-processing
  Language:JavaScript 10

• jaehyeon-kim / kafka-pocs

  Apache Kafka and Related Projects

  awskafkakafka-connectmskmsk-connectpythondata-streamingdockerdocker-composereal-time-analytics
  Language:Shell 9

• jlumbroso / java-random-hash

  A simple, time-tested, family of random hash functions in Java, based on CRC32, affine transformations, and the Mersenne Twister. 🎲

  javahash-functionshyperloglogflajoletflajolet-martindata-streaming
  Language:Java 9

• jlumbroso / python-random-hash

  A simple, time-tested, family of random hash functions in Python, based on CRC32 and xxHash, affine transformations, and the Mersenne Twister. 🎲

  data-streamingflajoletflajolet-martinhash-functionshyperloglogpythonanalysis-of-algorithmsanalytic-combinatoricsrandomized-algorithmstreaming-algorithms
  Language:Python 9

• MasWag / monaa

  A Tool for Timed Patten Matching with Automata-Based Acceleration

  runtime-verificationmonitoringautomatamonitoring-toolregular-expressiondata-streamingformal-specification
  Language:C++ 9

• PubNubDevelopers / Real-Time-Data-Streaming-Demo

  Demonstration of PubNub's real-time data streaming capabilities from Twitter, Wikipedia & more

  pubnubdatadata-streamingevent-drivenmessagingmultiplayerpublishpubsubpushreal-timestreamingsubscribetwitterwikipediareal-time-messaging
  Language:JavaScript 9

• blitzkz23 / final-project-end-to-end-banking-campaign-pipeline

  Final Project for IYKRA Data Fellowship 8 Program, creating an end-to-end banking campaign pipeline using lambda architecture (providing acess to batch and stream processing)

  batch-processingdata-engineeringdata-pipelinedata-streaming
  Language:Python 8

• goldsmocap / mocap-streamer

  Goldsmiths Mocap Streamer is a cutting-edge tool that streams live motion capture (BVH) data over the internet, allowing users from multiple remote locations to interact in the same shared digital space.

  data-streamingelectronmotion-capture-datawebsocket
  Language:TypeScript 8

• apache / doris-kafka-connector

  Kafka Connector for Apache Doris

  apachedata-streamingdorisetlkafkakafka-connectmppolap
  Language:Java 6

• officialarijit / Fed-ReMECS-mqtt

  A Federated Learning Method for Real-time Emotion State Classification from Multi-modal Streaming

  federated-learningfederated-learning-algorithmrealtime-frameworkemotion-recognitionrealtime-emotion-recognitionfederated-learning-applicationdata-streamingdata-stream-classification
  Language:Python 6

• zabir-nabil / picast

  A lightweight fast data streaming library for raspberry pi in python.

  raspberry-pidata-streamingvideo-streamingsensors-data-collectionserver-client-communication
  Language:Python 6
• Ixian-S2

  ProjectIxian / Ixian-S2

  Ixian S2 end to end data streaming network software

  blockchaincryptocurrencycryptographydata-streamingdecentralizedixianp2pstreamingwallet
  Language:C# 5

• turulix / memphis-rust-community

  A Memphis SDK written in rust.

  data-streamingmemphismessage-queuemessagingrust
  Language:Rust 5

• officialarijit / RPWE

  Reward Penalty Weighted Ensemble approach for multimodal data stream classification

  data-streamingemotion-recognitionensemble-machine-learningensemble-learningdatastreaming
  Language:Jupyter Notebook 4

• ThiagoBarradas / logstash-beats-demo

  Elastic Stack with Nginx, Logstash and Beats demo

  logstashbeatselasticelasticsearchdemodatadata-processingdata-pipeplinedata-streaming
  4

• AbdullahMu / Data-Streaming-Nanodegree-Project_02-Evaluate-Human-Balance-with-Spark-Streaming

  Design data streaming architecture and API for a real-life application called the Step Trending Electronic Data Interface (STEDI). It is a working application used to assess fall risk for seniors. When a senior takes a test, they are scored using an index which reflects the likelihood of falling, and potentially sustaining an injury in the course of walking. STEDI uses a Redis datastore for risk score and other data. The Data Science team has completed a working graph for population risk at a STEDI clinic. The problem is the data is not populated yet. You will work with Kafka Connect Redis Source events and Business Events to create a Kafka topic containing anonymized risk scores of seniors in the clinic.

  apache-kafkaapache-sparkapibase64data-streamingkafkaredisspark-streamingspark-streaming-kafka
  Language:Python 3

• jlumbroso / affirmative-sampling

  Reference implementation of the Affirmative Sampling algorithm by Jérémie Lumbroso and Conrado Martínez (2022). 🍀

  cardinality-estimationdata-streamingrandom-samplingaffirmative-samplingprobabilistic-algorithm
  Language:Python 3
• mobility-ai

  kanenorman / mobility-ai

  Full Stack Machine Learning Engineer Project - Real Time Data Streaming and Predictions

  data-streamingflaskmachine-learningpythonkafkadockerdata-sciencepostgresql
  Language:Python 3

• MengLinMaker / IMU-Webserial-Visualiser

  Visualising IMU orientation using "Three.js" via the experimental "Web Serial API".

  3ddata-streamdata-streamingesp32imuimu-and-ahrs-algorithmsimu-dataimu-guiimu-sensorthree-jsthreejsvisualise-datavisualizationvisualizerahrs
  Language:JavaScript 3

• the-timoye / songstreams

  Streams simulated events using Kafka & Spark, from a music application to a data lake (AWS S3), and then a warehouse (AWS Redshift)

  awsdata-engineeringdata-streamingkafka-streamspython3spark-streamingterraformdbt
  Language:Python 3

• MengLinMaker / ESP32-data-stream-comparisons

  Comparing data streaming methods from ESP32

  data-streamdata-streamingesp32espnowiotwirelesswireless-communication
  Language:C++ 2