There are 4 repositories under livy topic.
Jupyter magics and kernels for working with remote Spark clusters
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
Spark on Kubernetes infrastructure Helm charts repo
A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
Spark on Kubernetes infrastructure Docker images repo
Loan Default Prediction using PySpark, with jobs scheduled by Apache Airflow and Integration with Spark using Apache Livy
Livy Manager - Web UI for Managing Apache Livy Sessions
Experiments produced during an end of studies project (ETS, H2018)
C# Livy client to submit Spark jobs to HDInsight and other Spark clusters
hdsf, hadoop & spark dockers for study
An airflow DAG transformation framework
HDInsight provider for Airflow
Experiment to get LIVY+ Apache Spark working on DC/OS + MESOS + Docker
This is a web-based movie recommendation application written in Scala using Apache Spark and Livy.
An Airflow plugin which supply some AWS operators with extended feature over the build in Airflow's operators
Data Engineering Tools
Use Spark with Livy along with Application Insights. Learn to host your external dependencies in data lake.
Go API client for Apache Livy | Work in progress
Jupyterlab with Spark 2.4.8 integrated with help of Livy and Sparkmagic
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
PennBook is a highly scalable implementation of the core functionalities of facebook.com. It uses a Node.js server, React.js for the frontend, and Hadoop libraries such Apache Spark along with AWS Elastic MapReduce for the Big Data functionalities.
Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.
A Livy server for submitting Spark applications, with PySpark pre-configured
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.