suchenzang

incubator-airflow

Apache Airflow (Incubating)

incubator-tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

sPCA

Scalable PCA (sPCA) is a scalable implementation of Principal component analysis algorithm on top of Spark

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

laptop-setup

livy

Livy is an open source REST interface for interacting with Apache Spark from anywhere

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

auks

Kerberos credential support for batch environments

bitsandbytes

8-bit CUDA functions for PyTorch

hive

Mirror of Apache Hive

Megatron-LM

Ongoing research training transformer language models at scale, including: BERT & GPT-2

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

repostrip

Testing bfg stripping

repostrip_source

spark

Mirror of Apache Spark

suchenzang.github.io

university-domains-list

University Domains and Names Data List & API

wikiextractor

A tool for extracting plain text from Wikipedia dumps

xsbt-web-plugin

Build J2EE Web applications in Scala.