amazon-emr

There are 3 repositories under amazon-emr topic.

• aws-samples / aws-dbs-refarch-datalake

  Reference Architectures for Datalakes on AWS

  data-lakedata-analyticsamazon-emringest-dataemr-clustergluehive-metastoredata-catalogdata-transformation
  Language:HTML 75
• modern-data-lake-storage-layers

  dacort / modern-data-lake-storage-layers

  Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work

  awsamazon-emrhudiicebergapache-hudiapache-icebergdelta-lake
  Language:Jupyter Notebook 44

• garystafford / aws-airflow-demo

  Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for Apache Airflow (MWAA) on AWS.

  airflowamazon-emrpyspark-applicationsapache-airflowawsamazon-mwaa
  Language:Python 42

• garystafford / emr-demo

  Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.

  emr-demoamazon-emrpysparkelastic-map-reduceawsspark
  Language:Python 38

• awslabs / amazon-emr-cli

  A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs

  awsamazon-emrapache-sparkemr-serverless
  Language:Python 33

• awslabs / amazon-emr-vscode-toolkit

  A VS Code Extension to make it easier to manage and develop Spark jobs on EMR

  amazon-emrapache-sparkpysparkpython
  Language:TypeScript 28

• dacort / demo-code

  Bits of code I use during live demos

  emr-clusteraws-emremr-notebooksaws-cloudformationaws-cloudformation-templatesaws-athenaamazon-athenaamazon-emrlive-demos
  Language:Jupyter Notebook 28

• snowplow / dataflow-runner

  Run templatable playbooks of Hadoop/Spark/et al jobs on Amazon EMR

  amazon-emrflinkgolang-applicationhadoopspark
  Language:Go 19

• aws-samples / amazon-emr-with-delta-lake

  Amazon EMR Notebook to show how to read from and write to Delta tables with Amazon EMR

  amazon-emrsparkdeltalake
  Language:Jupyter Notebook 17

• polakowo / yelp-3nf

  3NF-normalize Yelp data on S3 with Spark and load it into Redshift - automate the whole thing with Apache Airflow

  yelp-datasetamazon-redshiftdata-martsdata-pipelinedimensional-tabless3-bucketsparketl-processdata-warehouseairflownosqlsqlamazon-emrcloud3nfnormalization
  Language:Jupyter Notebook 12

• Ditectrev / Amazon-Web-Services-Certified-AWS-Certified-Machine-Learning-MLS-C01-Practice-Tests-Exams-Question

  ⛳️ PASS: Amazon Web Services Certified (AWS Certified) Machine Learning Specialty (MLS-C01) by learning based on our Questions & Answers (Q&A) Practice Tests Exams.

  amazon-athenaamazon-cloudwatchamazon-comprehendamazon-ec2amazon-emramazon-s3amazon-sagemakeramazon-textractamazon-transcribeapache-sparkawsaws-batchaws-certifiedaws-certified-machine-learningaws-glueaws-lambdalinear-regressionmachine-learningmls-c01neural-network
  11

• aws-samples / amazon-s3-access-points-for-cross-account-integration-samples

  This repo provides cross-account integration code samples using Amazon S3 Access points

  amazon-s3amazon-s3-access-pointsamazon-emraws-cross-account-s3-integration
  Language:Java 5

• build-on-aws / ci-cd-serverless-spark

  Sample CI/CD pipeline for using GitHub Actions with Amazon EMR Serverless Spark.

  amazon-emrapache-sparkawsgithub-actionsserverlessspark
  Language:Python 5

• cameres / emr-spark-jupyter

  :notebook: Repository/Tutorial for initiallizing Jupyter Notebook and Spark cluster on Amazon EMR

  amazon-emrclusteremrjupyterjupyter-notebooksparkspark-clusterstutorial
  Language:Python 4

• DeepHiveMind / Amazon-EMR-on-Amazon-EKS-Spark-job-with-AWS-Step-Functions

  Orchestrate an Amazon EMR on Amazon EKS Spark job with AWS Step Functions

  amazon-emramazon-ekssparkaws-step-functionsaws
  3

• Ditectrev / Amazon-Web-Services-Certified-AWS-Certified-Data-Analytics-DAS-C01-Practice-Tests-Exams-Question

  ⛳️ PASS: Amazon Web Services Certified (AWS Certified) Data Analytics Specialty (DAS-C01) by learning based on our Questions & Answers (Q&A) Practice Tests Exams.

  amazon-athenaamazon-auroraamazon-cloudwatchamazon-ec2amazon-emramazon-quicksightamazon-rdsamazon-s3apache-kafkaapache-sparkawsaws-certifiedaws-data-analyticsaws-glueaws-lambdadas-c01hdfspractice-exampractice-examspractice-test
  3

• aws-samples / amazon-emr-yarn-capacity-scheduler

  Configure Hadoop YARN CapacityScheduler on Amazon EMR on Amazon EC2 for multi-tenant heterogeneous workloads

  amazon-emrapache-hadoop-yarnaws-cloudformationcapacity-schedulerfair-schedulerfifo-scheduler
  Language:Shell 1

• esakik / data-engineering-essentials

  Samples related to data engineering, e.g. spark, embulk, airflow, etc.

  apache-beamapache-sparkapache-airflowapache-hadoopfluentdembulkdigdagmrjobcloud-dataproccloud-dataflowamazon-emrprotocol-buffersapache-avrodata-engineering
  Language:Python 1

• garystafford / emr-superset-demo

  Project files for the post: Installing Apache Superset on Amazon EMR: Add data exploration and visualization to your analytics cluster.

  amazon-emrapache-supersetsupersetaws
  Language:Python 1

• Mohammed-siddiq / Page-Rank-In-Spark

  Page rank implementation in SPARK to rank authors and venues based on their publications in the DBLP dataset.

  amazon-emramazon-s3dblp-datasetpagerank-algorithmsbtscalaspark
  Language:Scala 1

• Sampsonyu / Data_Lake_with_Spark

  Data Lake with Spark

  python3awsamazon-emramazon-s3sparkspark-sqldata-lakeelt
  Language:Jupyter Notebook 1

• tmusabbir / emr-with-custom-metrics

  Amazon EMR Automatic Scaling using Custom Metrics

  emramazon-emramazon-web-servicescloudwatchbigdataemr-cluster
  Language:Shell 1

• DarthVi / knn-ncc-spark

  An implementation in Scala of kNN and NCC based on Spark

  scalasparkknnnccmachine-learningamazon-emr
  Language:Scala 0

• jaceyca / Rankmaniac

  Used Amazon's Elastic MapReduce to rank the top 20 nodes based on PageRank of graphs with over 100,000 nodes http://courses.cms.caltech.edu/cs144/homeworks/rankmaniac.pdf

  mapreduceamazon-emr
  Language:Python 0

• MrBenA / Udacity_Capstone-ETL_Pipeline

  Udacity Data Engineering Capstone project

  amazon-web-servicesamazon-s3amazon-emramazon-redshiftapache-sparkpythondata-modelingrelational-databasesextract-transform-load
  Language:Python 0

• Rituraj0480 / Quad-Squad

  CMPT 732 Project: Our project revolves around a bike-sharing firm, and as analysts for that business, we will be using several big data tools to offer insights into various use cases, predicting their future profits and assisting them in expanding their business.

  pythonpysparksqlamazon-emramazon-s3saprksparkmltableaugitjupyter-notebook
  Language:Python 0

• robertgv / Data_Lake_in_AWS

  Udacity Data Engineering Nanodegree Program

  udacityudacity-nanodegreeudacity-data-engineer-nanodegreeamazon-s3amazon-emrapache-spark
  Language:Python 0

• timchansdp / Churn-Prediction-with-PySpark

  With Amazon EMR and machine learning techniques supported by PySpark, a model was built to assist the fictitious music streaming service provider to predict customer churn rate based on user click data.

  churn-predictionbig-datapysparkamazon-emr
  Language:Jupyter Notebook 0

• WorksApplications / ansible_aws_emr

  Unofficial Ansible module for Amazon EMR

  amazon-emransible-modulesemr-management
  Language:Python 0

• cmeb45 / fuzzyjoin

  mapreducestring-matchingaws-emramazon-emrmap-reducestring-similarity
  Language:Java

• Faisal-AlDhuwayhi / Data-Lake

  Building Data Lake and ETL pipelines using Amazon EMR, S3, and Apache Spark

  amazon-emramazon-s3awsbig-databig-data-processingcloud-computingdata-engineeringdata-lakeetl-pipelinepysparksparksql
  Language:Python

• Lostefra / SparkTemplate

  A simple Java-Scala mixed project template for Apache Spark

  amazon-emrintellijjavasbtscalaspark
  Language:Scala