dwyatte

prefect-demo

bert-vis

Visualizing word sense and domain shift in BERT representations

bias-correction

Incremental bias correction in PyTorch

blocks

Simple interface to read, organize, and manipulate structured data in files on local and cloud storage

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

dotfiles

My dotfiles for syncing and sharing

estimator

TensorFlow Estimator

FasterTransformer

Transformer related optimization, including BERT, GPT

fastertransformer_backend

hermit

Hermit manages isolated, self-bootstrapping sets of tools in software projects.

hermit-packages

Hermit manages isolated, self-bootstrapping sets of tools in software projects.

io

Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO

jax

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

label-shift

Label shift experiments in TensorFlow

llm-foundry

LLM training code for MosaicML foundation models

mlflow

Open source platform for the machine learning lifecycle

Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

pandas-malloc-benchmark

Optimizing Pandas DataFrame memory allocation

pydocker

serving

A flexible, high-performance serving system for machine learning models

sparseml

Libraries and state-of-the-art automatic sparsification algorithms to simplify and accelerate performance

sparsify

Easy-to-use autoML interface to optimize deep neural networks for better inference performance and a smaller footprint.

t5-encoder

A extension of Transformers library to include T5ForSequenceClassification class.

tensorflow

An Open Source Machine Learning Framework for Everyone

text

Making text a first-class citizen in TensorFlow.

text-generation-inference

Large Language Model Text Generation Inference

tink

Tink is a multi-language, cross-platform, open source library that provides cryptographic APIs that are secure, easy to use correctly, and hard(er) to misuse.

transformers

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.