pyspark-dataframes

There are 0 repository under pyspark-dataframes topic.

sbl-sdsc / df-parallel
Comparison of Dataframe libraries for parallel processing of large tabular files on CPU and GPU.
cuda-toolkit dask dask-cudf dask-dataframes dataframes gpu-computing parallel-processing pyspark-dataframes rapidsai
Language:Jupyter Notebook 6
maltzsama / sumeh
Sumeh — Unified Data Quality Framework Sumeh is a unified data quality validation framework supporting multiple backends (PySpark, Dask, Polars, DuckDB, Pandas) with centralized rule configuration.
dask-dataframes data data-quality data-quality-analysis data-quality-checks data-quality-framework data-quality-measurement data-quality-report duckdb duckdb-extension polars polars-dataframe polars-extensions pyspark pyspark-dataframes data-quality-assessment pandas pandas-library
Language:Python 3
mhaseebtariq / pyspark-helpers
Useful helper functions for PySpark dataframe operations
pyspark pyspark-notebook flexible-joins pyspark-dataframes pyspark-helpers pyspark-joins join-duplicate-columns
Language:Jupyter Notebook 0
RJBarker / home_sales
Use PySpark and SparkSQL to execute SQL queries through a temporary view of the DataFrame created. Conduct additional queries on cached and partitioned data to determine runtime comparisons.
big-data big-data-analytics cached large-scale partitioning pyspark pyspark-dataframes python sparksql
Language:Jupyter Notebook

sbl-sdsc / df-parallel