apachespark
There are 2 repositories under apachespark topic.
DataExpert-io / data-engineer-handbook
This is a repo with links to everything you'd ever want to learn about data engineering
Language:Jupyter Notebook 23744- Language:Java 5527
- Language:Scala 101
- ApacheSpark
martandsingh / ApacheSpark
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
Language:Python 95 funkyminds / cleanframes
type-class based data cleansing library for Apache Spark SQL
Language:Scala 79josephmachado / docker_for_data_engineers
Code for blog at: https://www.startdataengineering.com/post/docker-for-de/
Language:C 30propelledanalytics / SparkSQL.jl
SparkSQL.jl enables Julia programs to work with Apache Spark data using just SQL.
Language:Julia 25tspannhw / FLiPStackWeekly
FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...
- Language:Jupyter Notebook 12
SmartDataAnalytics / MA-INF-4223-DBDA-Lab
Repository for Lab “Distributed Big Data Analytics” (MA-INF 4223), University of Bonn
Language:Jupyter Notebook 11SandeepAswathnarayana / professional-certificate-programs
This repository contains all the projects and labs I worked on while pursuing professional certificate programs, specializations, and bootcamp. [Areas: Deep Learning, Machine Learning, Applied Data Science].
Language:Jupyter Notebook 9CarolinaNicasio / APACHESPARK-PYSPARK-2023
PySpark es una biblioteca de procesamiento de datos distribuidos en Python que permite procesar grandes volúmenes de datos en clústeres utilizando el framework Apache Spark, ofreciendo un alto rendimiento y un conjunto de herramientas integradas para el análisis y manejo de datos a gran escala.
datumbrain / gossub
Trigger spark-submit in Golang. A Go implementation of famous SparkLauncher.java.
Language:Go 7sfrechette / spark-jdbc-mssql
Connect to SQL Server using Apache Spark
Language:Scala 7- Language:Java 6
- Language:Java 5
Examples usages for cleanframes library
Language:Scala 5sahith / Link-Prediction-for-Citation-Networks-using-Apache-Spark
Link Prediction is about predicting the future connections in a graph. In this project, Link Prediction is about predicting whether two authors will be collaborating for their future paper or not given the graph of authors who collaborated for atleast one paper together.
Language:Scala 5AbdelmajidLh / spark-functionality-repo
Ce dépôt GitHub contient un document détaillé sur les bases du langage Scala.
divithraju / divith-raju-Immigration-Data-Engineering
A Capstone Project that covers several aspects of Data Engineering (Data Exploration, Cleaning, Modeling, Pipelining, Processing)
Language:Jupyter Notebook 3bartosz25 / data-ai-summit-2020
You will find here the demo codes for my Data+AI 2020 talk about customizing Apache Spark state store.
mayankrawat / CSVJoin
Use this project to join data from multiple csv files. Currently in this project we support one to one and one to many join. Along with this you can find how to use kafka producer efficiently with spark.
Language:Java 2MRYingLEE / Apache_Spark_in_Google_Colab
This is a Jupyter Notebook to practice Apache Spark in Google Colab, especially for the exam CCA Spark and Hadoop Developer Exam (CCA175).
Language:Jupyter Notebook 2Arkaprabha-B / PySpark-GraphFrames
Implementation of GraphFrames using PySpark in Eclipse IDE
Cloudslab / dSpark
Source code for the work "dSpark: Deadline-Based Resource Allocation for Big Data Applications in Apache Spark" published in IEEE e-Science 2017
Language:Java 1sarathchandrikak / ETL-Bank-Transcation
Data Analysis of bank transaction data
Language:Jupyter Notebook 1syedsaadahmed / Hands-on-with-Apache-Spark
Working with Apache Spark, Creating some small tutorials and at last implemeting a small project
Thapep / ApacheSpark
Apache Spark project for Advanced Topics on Databases course
Language:Python 1ZeroTwoDataRW / DE-Stream-Project-Random-Generated-User-Data
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.
Language:Python 1ayyankalu / Ipl_Data_analysis_Spark
This repository showcases IPL data analysis using Apache Spark. The project demonstrates the power of Spark for data transformation, cleaning, SQL queries, and visualization, all performed with PySpark to handle large-scale data efficiently.
Language:Jupyter Notebook 0Cyang18 / MusicProducer
This is a distributed system that utilizes Apache Spark through Dataproc. We use the Spotify API to send song data to Apache Spark, which then forwards the information to Google Cloud Services. The system processes this data to recommend songs based on the extracted information.
Language:Python 0meghna-cse / CloudComputingAndBigData-CSE6332
Projects completed as part of the CSE 6332 CCBD course at UTA, covering distributed computing, data processing frameworks, and cloud platforms.
Language:Java 0Orkhan-1 / Full-Course-Apache-Spark
This comprehensive course is designed for beginners and experienced developers alike, providing an in-depth exploration of Apache Spark
Language:Java 0ravishankar324 / Washington-state-electric-vehicles-ETL-pipeline
ETL Datapipeline to process Washington's EV data using Apache Spark, Docker, Snowflake, Airflow, AWS services and visualize the transformed parquet data by creating Tableau Dashboards.
Language:Python 0sakshi2k / apache-spark-databricks-job
Sample project to run databricks job using a java jar and utilising UDFs.
Language:Java 0SwethaJoseph / Crime-Pattern-Analysis-Project
Analysis and visualization of open-source police data from two areas, Leicestershire Street and Northumbria Street to derive data-driven insights
0
