winningsix

spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

system-design-101

Explain complex systems using visuals and simple terms. Help you prepare for system design interviews.

OpenLLM

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

isa-l_crypto

llama2.mojo

Inference Llama 2 in one file of pure 🔥

pmdk

Persistent Memory Development Kit

isa-l

Intelligent Storage Acceleration Library

modern-cpp-features

A cheatsheet of modern C++ language and library features.

Gluten-Trino

Gluten: Plugin to Boost Trino's Performance

flash-attention

Fast and memory-efficient exact attention

QATzip

Compression Library accelerated by Intel® QuickAssist Technology

pyspark-ai

English SDK for Apache Spark

incubator-gluten

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

BDTK

A modular acceleration toolkit for big data analytic engines

cloudtik

Cloud Scale Platform for Distributed Analytics and AI

alldata

AllData数据中台开源项目，以数据平台为底座，以数据中台为桥梁，以机器学习平台为中层框架，以大模型应用为上游产品，提供全链路数字化解决方案。加入技术社区：https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo

gazelle_plugin

Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.

confidential-computing-zoo

Confidential Computing Zoo provides confidential computing solutions based on Intel SGX, TDX, HEXL, etc. technologies.

kvdk

Key Value Development Kit

substrait

A cross platform way to express data transformation, relational algebra, standardized record expression and plans.

sql-ds-cache

Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.

KungFu

Fast and Adaptive Distributed Machine Learning for TensorFlow, PyTorch and MindSpore.

vaquarkhan

splash

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

SimpleCache

A simple version of Guava cache

commons-compress

Apache Commons Compress

CodeHub

CodeHub is an iOS application written using Xamarin

interviews

Everything you need to know to get the job.

commons-crypto

Apache Commons Crypto

SparkInternals

Notes talking about the design and implementation of Apache Spark