aws-emr-clusters
There are 3 repositories under aws-emr-clusters topic.
RubensZimbres / Repo-2019
BERT, AWS RDS, AWS Forecast, EMR Spark Cluster, Hive, Serverless, Google Assistant + Raspberry Pi, Infrared, Google Cloud Platform Natural Language, Anomaly detection, Tensorflow, Mathematics
Language:Jupyter Notebook 136terraform-aws-modules / terraform-aws-emr
Terraform module to create AWS EMR resources 🇺🇦
Language:HCL 21AWS-Big-Data-Projects / Run-a-Spark-job-within-Amazon-EMR
Run a Spark job within Amazon EMR
Language:Java 12- Language:Shell 7
felipeazucares / Airflow-EMR-Redshift
EMR + Hadoop to Redshift ELT workflow using spark steps API and orchestrated by Apache-Airflow, which ingests disparate datasets focused around 7Gb of I94 arrivals information to produce a simple star schema in Redshift
Language:Python 4abhibalani / emr_lambda
Lambda to start EMR and run a map reduce job
Language:Python 3khushal2405 / Daily-Incremental-load-ETL-pipeline-for-Ecommerce-company-using-AWS-Lambda-and-Apache-airflow
Daily Incremental load ETL pipeline for Ecommerce company using AWS Lambda and AWS EMR cluster, Deployed using Apache airflow in a docker container.
Language:Python 3anuragkr29 / TightCommunityDetection
Detect Tight Communities in a social Network
Language:Scala 2dvu4 / udacity-data-engineering
Data Engineering Projects including Data Modeling, Data Warehouse, Data Lake Development
Language:Jupyter Notebook 2nikhilsu / Product-review-analysis-Spark-MongoDB
Performing various product review analysis on Amazon dataset using Apache Spark and MongoDB
Language:Java 2rigganni / AWS-Spark-Million-Song-ETL
Load data from the Million Song Dataset into a final dimensional model stored in S3.
Language:Python 2rshinde03 / Default-Credit-Data-Analysis-and-Prediction-Using-Big-Data
Credit defaulting results in a large profit loss to banks and other credit lenders. The success of the banking industry results in the ability to understand risk. This project uses big data technologies like Mapreduce, HDFS along with PySpark and AWS for analysis of credit history and its prediction
Language:Jupyter Notebook 2- Language:Python 2
johnnyiller / cluster_funk
An opinionated framework for running big data jobs
Language:Python 1kacperstyslo / most-wanted-programming-skills-finder
With this app, you can see what programming skills are most in-demand in the current job market.
Language:Python 1m1theus / aws-emr-terraform
Example for provisioning AWS EMR service with Terraform
Language:HCL 1nihil21 / DocxAnonymizer-spark
Stand-alone Scala & Java tool to anonymize OOXML Documents (DOCX)
Language:Java 1sagardua297 / udacity-data-engineering-nd
Data Pipeline Analytics Platform is an end-to-end generic Big Data pipeline. Involves following tech stack: AWS S3, AWS Redshift, AWS EMR Cluster, Apache Spark, Apache Airflow.
Language:Python 1SRVivek1 / pyspark-rdd-dataframe-examples
PySpark RDD and DataFrame Examples
Language:Python 1xianchen2 / Analyzing_10GB_of_Yelp_Reviews_Data
AWS EMR backed Spark cluster for analyzing Yelp Data
Language:Jupyter Notebook 1AleGuarnieri / Data-Lake-ETL
Udacity project: implementing an ETL to process data with Apache Spark and store them in AWS S3 storage
Language:Python 0arjunsawhney1 / scalable-ML
In this repo, I build a LogisticRegression prediction model with Dask and PySpark and initialize an AWS EMR cluster to run the entire pipeline.
Language:Python 0Chan2k20 / Wine-Prediction-Prediction-Model-On-AWS-EMR
Implemented random forest machine learning algorithm using pyspark on AWS EMR to classify the wines. The model is then deployed in docker container.
Language:Python 0EricPaul075 / OCP8-Big-data-project-deployed-in-AWS-cloud
Define a big data architecture and perform distributed machine learning calculations on an EMR cluster using AWS
Language:Jupyter Notebook 0geewynn / techcrunch_warehouse
Built a data model, data warehouse and pipeline for extracting transforming and loading data into a star schema-based data model in a redshift database
Language:Python 0marcus-repo / etl-spark
ETL Pipeline extracts JSON files from AWS S3 bucket and transforms these using an AWS EMR Spark Cluster and stores the data into an AWS S3 bucket in parquet file format.
Language:Python 0mochan42 / Deploy-a-CNN-in-AWS-image-features-extraction-and-ACP
A CNN is deployed in AWS to extract image features in the context of distributed computing.
Language:Jupyter Notebook 0pavva94 / MovieSentimentAnalysis
MLP for Sentiment Analysis on Movie's Reviews.
Language:Scala 0- Language:HCL 0
SagarFall2022 / BigData
Realtime data pipeline
Language:Jupyter Notebook 0tugberkcapraz / capstone_sparkify
Predicting customer churn for the music app, Sparkify, using PySpark on AWS EMR clusters
Language:Jupyter Notebook 0Adith-Rai / Reddit-Stock-Sentiment-Analyzer
A Cloud based Reddit stock sentiment analyzer that analyzes overall sentiment from a configurable selection of stock subreddits for each stock. The architecture utilizes AWS MSK (Kafka), AWS EMR (PySpark) and AWS Lambda (Python 3) for maximum scalability and the OpenAI API for sentiment analysis through prompt engineering.
Language:Python- Language:Jupyter Notebook
im612 / P8_big_data
A scalable prototype of an image recognition engine deployed on AWS.
Language:Jupyter Notebookjjanczur / CloudComputing-assignment4
TU Berlin Cloud Computing - correctly implemented assignment4
Language:Java- Language:Python
