lambda-architecture
There are 3 repositories under lambda-architecture topic.
OryxProject / oryx
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Language:Java 1788Azure-Samples / streaming-at-scale
How to implement a streaming at scale solution in Azure
Language:C# 231Azure / azure-cosmosdb-spark
Apache Spark Connector for Azure Cosmos DB
Language:Scala 197KyleRoss / node-lambda-log
Basic logging mechanism for Node.js Lambda Functions and other AWS services, which produces logs in JSON format for easier reading through Cloudwatch Logs.
Language:JavaScript 193apssouza22 / big-data-pipeline-lambda-arch
A full big data pipeline (Lambda Architecture) with Spark, Kafka, HDFS and Cassandra.
Language:Java 162malleum-inc / canari3
Canari v3 - next gen Maltego framework for rapid remote and local transform development
Language:Python 141dwyl / phoenix-ecto-append-only-log-example
📝 A step-by-step example/tutorial showing how to build a Phoenix (Elixir) App where all data is immutable (append only). Precursor to Blockchain, IPFS or Solid!
Language:Elixir 78- Language:Scala 74
ymericson / big-data-streets
Big Data webapp using Chicago street congestion, crashes, red light violations, and speed camera violations
Language:Scala 35ivarvermeulen / nuxt-serverless-at-edge
Nuxt.js Serverless SSR using Cloudfront, Lambda@edge and S3
Language:Vue 34data-mill-cloud / data-mill
A K8s-based infrastructure for analytics
Language:Shell 24dorianbg / lambda-architecture-demo
Developing a Lambda Architecture pipeline using Apache Kafka, Spark Structured Streaming, Redshift, S3, Python
Language:Jupyter Notebook 24hmmhmmhm / serverless-ts-template
Serverless Typescript Template
Language:TypeScript 15LorenzoAgnolucci / TwitterRealTimeSentimentAnalysis
Lambda architecture implementation using Apache Storm, Hadoop and HBase to perform Twitter real-time sentiment analysis
Language:Java 6dennyglee / azure-cosmosdb-spark
Apache Spark Connector for Azure Cosmos DB
Language:Scala 5phatnguyen080401 / Real-Estate-Sale-Analytics
Create data pipeline using Lambda architecture with Spark, Kafka, Airflow and Snowflake
Language:Python 5markush81 / fast2smart
From Fast to Smart Data - Lambda Architecture with Apache Spark, Kafka and Cassandra
Language:Java 4adilkhash / awesome-data-engineering
A curated list of resources to navigate data engineering
aymane-maghouti / Big-Data-Project
This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.
Language:Python 3dgkanatsios / GameAnalyticsEventHubFunctionsCosmosDatalake
Big data reference architecture and implementation for an online multiplayer game
Language:JavaScript 3DmitryPukhov / spark-trade
Processing stock exchange data with Apache Spark
Language:Scala 3michalzeman / laPlatform
BigData concept for Lambda Architecture design pattern, Apache Kafka -> for streaming/data pipeline integration, Apache Spark -> for distributed data processing, RESTful, services -> Akka HTTP
Language:Scala 3nickozoulis / thunderstorm
Investigating the trade-offs of low latency responses over quality when applying machine learning algorithms over lambda architecture.
Language:Java 3nuald / lambda-sample
A Sample of Lambda Architecture Project
Language:Scala 3Akardian / lambda-architecture-for-distributed-mobile-sensor
Lambda architecture for distributed mobile sensor
Language:Java 2ChristophShyper / lambda-airly
AWS Lambda function/application invoking Airly API to get some basic information about current air quality
Language:HCL 2FaresKi / Scala-Project
Lambda architecture built in Scala and Java, made with love (and Kafka & Spark).
Language:Scala 2makohn / lambda-architecture-poc
♨️ A PoC implementation of the λ-Architecture for collecting and analysing tweets
Language:Scala 2Build lambda architecture
Language:Jupyter Notebook 2smsraj2001 / STREAM-BATCH-PROCESSING-KAFKA-SPARK
A project which includes simulation of real time queries by kafka and performing stream and batch processing of the simulated queries by spark. Also, this follows lambda architecture, in which kafka is publisher and spark helps in subscribing
Language:Python 2v4vigtory / Big-Data-Movie-Recommendation-App
Repository containing codes written for the capstone project on Movie Recommendation Engine for University of Chicago's Big Data Application Architecture course (MPCS 53014), taught in Fall 2022 by Mike Spertus
Language:CSS 2- Language:Python 2
dadoPuccio / Tweets-Sentiment-Analysis
Sentiment Classifier of Tweets, based on Lambda Architecture.
Language:Java 1lorenzotrcnl / flights-monitoring
Real-time flights monitoring using Lambda Architecture (API + KAFKA + SPARK + MONGO + GRAFANA)
Language:Python 1- FlightAnalysis
Lucass97 / FlightAnalysis
This project implemented a lambda architecture for analyzing domestic flight data in the US from 2009 to 2020. It used Apache Spark for batch processing, Spark Streaming for real-time analysis, and SVM models to predict flight cancellations and delays, with Docker for cluster management and Grafana for real-time visualization.
Language:Jupyter Notebook 1 - Language:C# 1
