spark-dataframes
There are 1 repository under spark-dataframes topic.
mahmoudparsian / pyspark-tutorial
PySpark-Tutorial provides basic algorithms using PySpark
Language:Jupyter Notebook 114726hzhang / StockPrediction
Plain Stock Close-Price Prediction via Graves LSTM RNNs
Language:Java 190Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
Language:HTML 150Thomas-George-T / Movies-Analytics-in-Spark-and-Scala
Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.
Language:Scala 96spider-123-eng / Spark
Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .
spark-streaming-datastreamingconsumerspark-transformationsspark-to-cassandra-connectionspark-kafka-integrationspark-dataframesspark-joinsspark-hive-contextspark-jdbc-connectionspark-with-mangodbspark-aggregations-using-dataframekafka-producerspark-sqlspark-use-casescassandra-installationparquetspark-datadogspark-mangodbspark-catalog-apiLanguage:Scala 55jubins / Spark-And-MLlib-Projects
This repository contains Spark, MLlib, PySpark and Dataframes projects
Language:Jupyter Notebook 40yennanliu / spark-etl-pipeline
Various data stream/batch process demo with Apache Scala Spark 🚀
Language:Scala 11jkoth / Data-Lake-with-Spark-and-AWS-S3
Create Data Lake on AWS S3 to store dimensional tables after processing data using Spark on AWS EMR cluster
Language:Python 9neerajkesav / SparkJavaExamples
Apache Spark Basics - Java Examples
Language:Java 9NashTech-Labs / Sparkathon
A library having Java and Scala examples for Spark 2.x
Language:Java 7afzals2000 / spark-bigquery-parallel
Spark BigQuery Parallel
Language:Scala 6MaxineXiong / Item-based-collaborative-filtering
This project utilizes PySpark DataFrames and PySpark RDD to implement item-based collaborative filtering. By calculating cosine similarity scores or identifying movies with the highest number of shared viewers, the system recommends 10 similar movies for a given target movie that aligns users’ preferences.
Language:Jupyter Notebook 2mayankrawat / CSVJoin
Use this project to join data from multiple csv files. Currently in this project we support one to one and one to many join. Along with this you can find how to use kafka producer efficiently with spark.
Language:Java 2- Language:Scala 2
ninjeanne / datastorm
Data Science and Engineering project - Programming for Big Data @ Simon Fraser University (SFU)
Language:Jupyter Notebook 2thenickben / SplitCSV-Spark
Big Data - Split a large CSV file into N smaller ones and save them into the local disk
Language:Scala 2- Language:Jupyter Notebook 2
AliElsaeid / Predicting-Kickstarter-Campaign-Success-Using-Machine-Learning
Predict the success of Kickstarter campaigns using machine learning. Analyze project data including financial goals, pledge amounts, categories, and outcomes. Perform data cleaning, queries, visualizations, and build models to forecast campaign success, helping entrepreneurs optimize their funding strategies
Language:Jupyter Notebook 1anshul1004 / MutualFriends
Implementation of Hadoop and Spark
Language:Java 1chinmayms / propinvestment
Predict Current Property Investment opportunities using Data Analysis (Big Data Spark ML)
Language:Python 1LucasDLee / CMPT-353-Final-Project
This is our final project for SFU's CMPT 353 taught by Greg Baker during Summer 2023
Language:Python 1mohamamd-safari / spark-hadoop-exercise
spark hadoop exercise of cloud computing course - aut 1402-1403 fall
Language:Jupyter Notebook 1RahulGupta16 / Pyspark-Theory-and-Code-Basics
Pyspark serves as a Python interface to Apache Spark, enabling the execution of Python and SQL-like instructions for the manipulation and analysis of data within a distributed processing framework.
Language:Jupyter Notebook 1rajeshsantha / MonitoredStructuredStreaming
Repository for Spark structured streaming use case implementations.
Language:Scala 1SevakAvet / spark-session-enricher
Calculate user sessions & stats on top of them for imaginary ecom site using Spark sql & aggregations
Language:Scala 1zaha2020 / Big_Data
This repository contains the implementation of a wide variety of BigData Projects in different applications of NoSQL databases, Spark, Data Pipelines, and map-reduce. These projects include university projects and projects implemented due to interest in BigData.
Language:Jupyter Notebook 1andrefnb / big_data_processing_natural_disasters
Map reduce / Spark / Dataframes queries for natural disaster dataset.
Language:Jupyter Notebook 0Bcromas / pyspark_projects
A collection of small projects exploring PySpark features and functionality including packages and modules, algorithms, and general data science techniques.
Language:Jupyter Notebook 0- Language:Scala 0
lalithvenkat / Analysis-of-M50-Highway-data-using-Spark
This Repo contains analysis of large data using Spark
Language:Jupyter Notebook 0- Language:Python 0
psanghal / bosch_manufacturing_line
UMSI-Bosch Manufacturing Line Failure Analysis
Language:Jupyter Notebook 0- Language:Python 0
WazirRohiman / Apache_Spark_Basics
This series explores the basics of Apache Spark with the application of some practical elements of Spark, PySpark & SparkSQL
Language:Jupyter Notebook 0amanjeetsahu / Apache-Spark-using-Scala
This repo contains my learnings and practices Zepplin notebooks on Spark using Scala. All the notebooks in the repo can be used as template code for most of the ML algorithms and can be built upon it for more complex problems.
