apache-flink

There are 16 repositories under apache-flink topic.

• ververica / flink-sql-cookbook

  The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.

  apache-flinkflinkstream-processingsqlflink-sql
  Language:Dockerfile 910

• nielsbasjes / yauaa

  Yet Another UserAgent Analyzer

  user-agentparseanalyzerjavahiveflinkapache-beamapache-flinkapache-hivenifi-processoruser-agent-parsernifi-processorssnowflakesnowplowsnowplowanalyticstrino-pluginuseragent-parseruseragentparserclient-hintsuser-agent-analysis
  Language:Java 872
• nussknacker

  TouK / nussknacker

  Low-code tool for automating actions on real time data | Stream processing for the users.

  flinkflink-kafkaapache-flinkguitoukreal-timedecision-makingkafkascalabig-datalow-codestreaminglowcodestream-processingautomationdata-streamingdecision-enginedecisioningrules-engine
  Language:Scala 703

• GoogleCloudPlatform / flink-on-k8s-operator

  [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.

  google-cloud-dataprocflink-operatorkubernetes-operatorapache-beamapache-flinkkubernetesoperator
  Language:Go 657

• alibaba / feathub

  FeatHub - A stream-batch unified feature store for real-time machine learning

  apache-flinkdata-engineeringdata-sciencefeature-engineeringfeature-storemachine-learningstreamingdatadata-qualitymlops
  Language:Python 340

• streamnative / pulsar-flink

  Elastic data processing with Apache Pulsar and Apache Flink

  apache-pulsarapache-flinkdata-processingbatch-processingstream-processingflinkflink-connectorschema-registryschemasqlflink-stream-processingcatalogpulsar
  Language:Java 282

• raystack / dagger

  Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

  stream-processingframeworkapache-flinkapache-kafkareal-time-processingreal-time-analyticsprometheusinfluxdbdataops
  Language:Java 277
• gradoop

  dbs-leipzig / gradoop

  Distributed Temporal Graph Analytics with Apache Flink

  graphproperty-graphdistributed-graph-analyticsapache-flinkgraph-miningpattern-matchingtemporal-graph
  Language:Java 249

• knaufk / flink-faker

  A data generator source connector for Flink SQL based on data-faker.

  flinkapache-flinkflink-sql
  Language:Java 231

• spotify / flink-on-k8s-operator

  Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.

  kubernetesapache-beamapache-flinkkubernetes-operatorflink-operatorflink
  Language:Go 219

• FlinkML / flink-tensorflow

  flink-tensorflow - TensorFlow support for Apache Flink

  tensorflowapache-flink
  Language:Scala 216

• ottogroup / flink-spector

  Framework for Apache Flink unit tests

  flinkstreamingunit-testingapache-flink
  Language:Java 210

• Chabane / bigdata-playground

  A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

  dockerspark-sqlscalakafkahbaseparquetavronodejsangulargraphqlmongodbmachine-learningbig-datahadoopapache-sparkapache-flinkspark-streamingtwitter-apipythonkops
  Language:TypeScript 209

• ing-bank / flink-deployer

  A tool that help automate deployment to an Apache Flink cluster

  apache-flinkflinkgolanggodockerdeployment
  Language:Go 150

• pdaodao / fiflow

  flink-sql 在 flink 上运行 sql 和 构建数据流的平台 基于 apache flink 1.10.0

  flinksqlstreamingapache-flink
  Language:Java 111

• josephmachado / beginner_de_project_stream

  Simple stream processing pipeline

  apache-flinkdataengineeringdatapipelinepostgresqlgraphanaprometheus
  Language:Python 110

• FlinkML / flink-jpmml

  flink-jpmml is a fresh-made library for dynamic real time machine learning predictions built on top of PMML standard models and Apache Flink streaming engine

  flink-jpmmlapache-flinkpmmlpredictionmodel-serving
  Language:Scala 96

• getindata / dbt-flink-adapter

  Adapter for dbt that executes dbt pipelines on Apache Flink

  apache-flinkdata-streamingdbtstreaming-analytics
  Language:Python 96

• streamnative / awesome-pulsar

  A curated list of Pulsar tools, integrations and resources.

  apache-pulsarpub-submessagingapache-bookkeeperapache-kafkaapache-flinkapache-sparkelastic-beatsgrafana-dashboardprometheusapache-stormsparkspark-structured-streamingspark-sql
  85

• seznam / euphoria

  Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.

  big-dataapache-flinkapache-sparkjava-apihadoopkafkahdfsunified-bigdata-processingstreaming-databatch-processing
  Language:Java 83

• twalthr / flink-api-examples

  Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.

  data-engineeringflinkflink-examplesflink-sqlstream-processingapache-flink
  Language:Java 65

• abeltavares / real-time-data-pipeline

  📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.

  apache-flinkapache-icebergapache-kafkaapache-supersetbig-datadata-engineeringdata-pipelinedockerlakehouseminioreal-time-datastreaming-analyticstrinodata-visualizationopen-sourcesql-analyticsetlawss3
  Language:Python 52

• aws-samples / amazon-kinesis-data-analytics-flink-starter-kit

  Amazon Kinesis Data Analytics Flink Starter Kit helps you with the development of Flink Application with Kinesis Stream as a source and Amazon S3 as a sink. This demonstrates the use of Session Window with AggregateFunction.

  amazon-kinesis-data-analytics-flinkamazon-kinesis-streamsapache-flinkreal-time-stream-processing
  Language:Java 47

• airscholar / FlinkCommerce

  This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessary infrastructure components, including Apache Flink, Elasticsearch, and Postgres

  apache-flinkbig-databig-data-processingpythonrealtime-streaming
  Language:Java 45

• garystafford / streaming-sales-generator

  Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python

  kafkastreaming-datapythonanalyticsapache-kafkadataspark-structured-streamingapache-flinkkafka-streamskstreams
  Language:Python 44

• realtimedatalake / rtdl

  rtdl makes it easy to build and maintain a real-time data lake

  open-sourcedatadata-engineeringdata-analysisdata-sciencedata-collectionproduct-analyticsmarketing-analyticscustomer-databig-datadata-lakegolangapache-flinkstateful-functionsapache-kafkareal-time-data-lakertdldockerdocker-composedremio
  Language:Go 43

• ververica / jupyter-vvp

  Jupyter Integration for Flink SQL via Ververica Platform

  jupyterflinkapache-flink
  Language:Python 43

• raycad / stream-processing

  Stream processing guidelines and examples using Apache Flink and Apache Spark

  apache-sparkapache-flinkdata-analysisstreamingbatch-processing
  Language:Java 42

• confluentinc / vscode

  Confluent for Visual Studio Code

  confluentconfluent-cloudkafkavscodeapache-flinkapache-kafkaconfluent-platformflinkkafka-consumerkafka-producerkstreamsmessageschemaschema-registryscriptstemplatesvscode-extension
  Language:TypeScript 31

• GMAP / DSPBench

  A suite of benchmark applications for distributed data stream processing systems

  apache-flinkapache-sparkapache-stormbig-databig-data-analyticsbigdatadata-streamevaluationexperimentsspark-streamingstormstream-processing
  Language:Java 31

• build-on-aws / prioritizing-event-processing-with-apache-kafka

  Technical solution to implement event processing prioritization with Apache Kafke using the concept of buckets.

  amazon-mskamazon-msk-connectapache-flinkapache-kafkaevent-processingkafka-connectkafka-streams
  Language:Java 30

• gordonmurray / apache_flink_and_docker_compose

  A complete real-time Change Data Capture (CDC) pipeline using Apache Flink, MariaDB, and Docker Compose. This project demonstrates how to build a modern streaming analytics system that processes database changes in real-time.

  cdcmariadbapache-flink
  Language:Dockerfile 29

• cyberdelia / flink-kotlin

  Kotlin support for Apache Flink

  flinkkotlinserializationapache-flink
  Language:Kotlin 23

• oceanbase / flink-connector-oceanbase

  Apache Flink Connectors for OceanBase.

  oceanbaseflinkobkvflink-connectorobkv-hbaseapache-flink
  Language:Java 22

• sanderploegsma / flink-k8s

  Example Apache Flink cluster on Kubernetes

  kubernetesapache-flink
  Language:Kotlin 22

• tj--- / iceberg-demo

  A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino

  apache-flinkapache-icebergapache-kafkaflinkflink-stream-processingicebergkafkatrinogcsjava
  Language:Java 22