saLeox

Distributed-Scheduled-Job

For the distributed scheduling job, analyse the mainstream frameworks, make a trade-off based on some indicators, pick the elastic-job as the final solution, and provide its tutorial under springboot.

Kafka-Cluster-Docker-Setup

Use docker compose to install the kafka cluster with UI tools: CMAK and Kafdrop. There are also some basic CIL of Kafka, that will be executed within images.

Concurrent-Balance-Deduction

Design of balance deduction in concurrency context, especially in the area of e-commerce.

flink-cdc-connectors

Change Data Capture (CDC) Connectors for Apache Flink

GitLab_CICD_Instructor

GitLab CICD Instruction on Linux machine, based on Springboot project.

PE-Appointment-Demo

A demo for high-concurrent purchase behavior and workflow within the company.

Springboot-Hateoas

A simple demo combines the usage of hateoas, springboot, swagger and knife4j.

Distributed-Delayed-Queue

The implementation for delayed queue based on rabbit mq and spring cloud stream.

Firestorm

Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark applications to store shuffle data on remote servers

flink

Apache Flink

God-Of-BigData

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

incubator-linkis-website

Apache Linkis documents

incubator-streampark

StreamPark, Make stream processing easier! easy-to-use streaming application development framework and operation platform

incubator-streampark-website

Apache streampark Website

Kafka-Springboot-Integration

Kafka integration in Springboot, including producer, consumer, streaming, and interactive query of Ktable.

Lambda-Architecture-BigData-Pipeline-Curation

Curation of big data pipeline, applying lambda architecture, combining batching and streaming processing. Use the Springboot and Spark to implement.

Lambda-BatchTraining-HousePricePredict

Use Spark-Milib Java library to perform machine learning (regression problem)

Lambda-ServingAPI-HousePricePredict

Embeding the machine learning from spark-mllib into Springboot to provide house price prediction API

Lambda-Streaming-HousePricePredict

Using kafka streaming to implement the streaming ETL job, append data onto GCP Big Query after formatting.

Linkis

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

photoHub

spark

Apache Spark - A unified analytics engine for large-scale data processing

sql-training

zeppelin

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.