spark-sql

There are 28 repositories under spark-sql topic.

getredash / redash
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
analytics athena bi bigquery business-intelligence dashboard databricks hacktoberfest javascript mysql postgresql python redash redshift spark spark-sql visualization
Language:Python 25459
apache / kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
data-lake hacktoberfest hadoop hive jdbc kubernetes spark spark-sql sql thrift
Language:Scala 2018
dotnet / spark
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
spark csharp dotnet analytics bigdata spark-streaming spark-sql machine-learning fsharp dotnet-core dotnet-standard streaming apache-spark tpcds tpch azure hdinsight databricks emr microsoft
Language:C# 2010
almond-sh / almond
A Scala kernel for Jupyter
jupyter scala jupyter-notebook repl jupyter-kernels spark spark-sql
Language:Scala 1577
databricks / LearningSparkV2
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
apache-spark spark structured-streaming spark-sql spark-mllib mllib mlflow delta-lake
Language:Scala 1139
apache / incubator-gluten
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
arrow clickhouse simd spark-sql vectorization velox
Language:Scala 1082
oeljeklaus-you / UserActionAnalyzePlatform
电商用户行为分析大数据平台
spark java hadoop sparkjava spark-sql accumulator kyro
Language:Java 943
ploomber / jupysql
Better SQL in Jupyter. 📊
jupyter sql duckdb mysql bigquery clickhouse hive postgres presto python redshift snowflake spark-sql sqlite trino tsql data-engineering data-science polars
Language:Python 668
qubole / sparklens
Qubole Sparklens tool for performance tuning Apache Spark
spark scala simulation scheduler scheduling performance performance-analysis performance-metrics performance-tuning performance-visualization spark-sql sparkjava spark-mllib spark-ml spark-applications cluster spark-job
Language:Scala 557
japila-books / spark-sql-internals
The Internals of Spark SQL
apache-spark book internals mkdocs-material spark spark-sql
447
zsvoboda / ngods-stocks
New Generation Opensource Data Stack Demo
cube dagster datahub dbt iceberg metabase python spark spark-sql trino trinodb
Language:Jupyter Notebook 390
kevinschaich / pyspark-cheatsheet
🐍 Quick reference guide to common patterns & functions in PySpark.
pyspark pyspark-tutorial cheatsheet cheat cheatsheets reference references documentation docs data-science data spark spark-sql guide guides quickstart
381
microsoft / data-accelerator
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
spark spark-streaming spark-sql sparksql streaming-data streaming servicefabric nodejs docker hdinsight cosmosdb react azure apache-spark iothub eventhub big-data iot kafka kafka-streams
Language:C# 294
cuebook / cuelake
Use SQL to build ELT pipelines on a data lakehouse.
apache-iceberg delta lakehouse datalake data-lake elt etl data-engineering data-integration data-ingestion apache-spark spark-sql upsert incremental-updates data-transfer pipelines data-pipeline zeppelin-notebook sql
Language:JavaScript 283
jaceklaskowski / spark-workshop
Apache Spark™ and Scala Workshops
apache-spark spark spark-mllib spark-sql spark-structured-streaming spark-workshops workshop
Language:HTML 257
Chabane / bigdata-playground
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
docker spark-sql scala kafka hbase parquet avro nodejs angular graphql mongodb machine-learning big-data hadoop apache-spark apache-flink spark-streaming twitter-api python kops
Language:TypeScript 205
qbeast-spark
Qbeast-io / qbeast-spark
Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
big-data data-lakehouse datasource sampling scala spark spark-sql
Language:Scala 205
microsoft / MCW-Big-data-analytics-and-visualization
MCW Big data analytics and visualization
machine-learning azure-data-factory hdinsight spark-sql database-administrator power-bi
Language:JavaScript 193
bdp
bluishglc / bdp
A prototype project of big data platform, the source codes of the book Big Data Platform Architecture and Prototype
bigdata prototype quickstart spark spark-streaming spark-sql demo oozie redis kafka spark-demo spark-streaming-examples sqoop sqoop-import sparksql spark-examples middle-end middle-office
Language:Java 192
polomarcus / Spark-Structured-Streaming-Examples
Spark Structured Streaming / Kafka / Cassandra / Elastic
cassandra kafka spark spark-sql structured-streaming
Language:Scala 182
mc2-project / opaque-sql
An encrypted data analytics platform
analytics enclave machine-learning privacy security spark spark-sql
Language:Scala 178
xiaogp / recsys_spark
Spark SQL 实现 ItemCF，UserCF，Swing，推荐系统，推荐算法，协同过滤
collaborative-filtering recommender-system spark-sql
Language:Scala 130
LearningJournal / Spark-Streaming-In-Python
Apache Spark 3 - Structured Streaming Course Material
apache-spark spark-streaming spark-sql pyspark python big-data bigdata data-lake
Language:Python 117
wangj1106 / recommendMoteur
电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎
recommendation-engine recommender-system recommendation movies als spark spark-streaming spark-sql flume kafka
Language:Scala 114
streamnative / pulsar-spark
Spark Connector to read and write with Pulsar
apache-pulsar apache-spark spark structured-streaming spark-sql data-processing data-science batch-processing stream-processing flink
Language:Scala 111
Real-time-Data-Warehouse
izhangzhihao / Real-time-Data-Warehouse
Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
flink data-warehouse real-time-data-warehouse data-warehousing flink-sql debezium kafka elasticsearch delta-lake cdc change-data-capture hudi hoodie iceberg sql datalake delta deltalake spark spark-sql
Language:Dockerfile 101
minio / spark-select
A library for Spark DataFrame using MinIO Select API
select bigdata spark spark-sql amazon-s3 parquet-files pyspark sbt minio
Language:Scala 96
Thomas-George-T / Movies-Analytics-in-Spark-and-Scala
Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.
spark spark-sql rdd shell-script big-data dataframes movielens-data-analysis big-data-analytics big-data-projects spark-programs scala movielens-dataset analytics case-study spark-dataframes spark-rdd hadoop spark-scala movies
Language:Scala 96
ApacheSpark
martandsingh / ApacheSpark
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
apachespark data-analysis data-engineering database databricks datalake deltalake etl-pipeline hadoop hive spark spark-sql spark-streaming timetravel etl pyspark sql
Language:Python 88
LearningJournal / SparkProgrammingInScala
Apache Spark Course Material
apache-spark spark spark-sql spark-scala big-data bigdata datalake data-lake scala
Language:Scala 83
huangyueranbbc / SparkDemo
spark全示例代码(java、scala) Spark most full instance code DEMO (java、scala)
spark hadoop bigdata operator sparkjava spark-sql spark-streaming sparkfun-products sparkline sparkp
Language:Java 81
streamnative / awesome-pulsar
A curated list of Pulsar tools, integrations and resources.
apache-pulsar pub-sub messaging apache-bookkeeper apache-kafka apache-flink apache-spark elastic-beats grafana-dashboard prometheus apache-storm spark spark-structured-streaming spark-sql
79
big_data
groda / big_data
Tutorials on Big Data essentials: Hadoop, MapReduce, Spark.
big-data bigdata spark spark-sql docker mapreduce mapreduce-bash pyspark hadoop testdfsio jupyter-notebook apache-sedona hadoop-cluster hadoop-hdfs mrjob gutenberg-ebooks
Language:Jupyter Notebook 62
sjrusso8 / spark-connect-rs
Apache Spark Connect Client for Rust
grpc-client spark spark-connect spark-sql
Language:Rust 60
zsvoboda / ngods
New generation opensource data stack
analytics data data-pipeline iceberg jdbc presto prestodb prestosql python scala spark spark-sql sparksql sql trino trinodb
Language:Dockerfile 60
harryprince / geospark
bring sf to spark in production
apache-spark gis large-scale-spatial-analysis r spark-sql sparklyr-extension spatial-analysis spatial-queries
Language:R 57

spark-sql

getredash / redash

apache / kyuubi

dotnet / spark

almond-sh / almond

databricks / LearningSparkV2

apache / incubator-gluten

oeljeklaus-you / UserActionAnalyzePlatform

ploomber / jupysql

qubole / sparklens

japila-books / spark-sql-internals

zsvoboda / ngods-stocks

kevinschaich / pyspark-cheatsheet

microsoft / data-accelerator

cuebook / cuelake

jaceklaskowski / spark-workshop

Chabane / bigdata-playground

Qbeast-io / qbeast-spark

microsoft / MCW-Big-data-analytics-and-visualization

bluishglc / bdp

polomarcus / Spark-Structured-Streaming-Examples

mc2-project / opaque-sql

xiaogp / recsys_spark

LearningJournal / Spark-Streaming-In-Python

wangj1106 / recommendMoteur

streamnative / pulsar-spark

izhangzhihao / Real-time-Data-Warehouse

minio / spark-select

Thomas-George-T / Movies-Analytics-in-Spark-and-Scala

martandsingh / ApacheSpark

LearningJournal / SparkProgrammingInScala

huangyueranbbc / SparkDemo

streamnative / awesome-pulsar

groda / big_data

sjrusso8 / spark-connect-rs

zsvoboda / ngods

harryprince / geospark