Dean Wyatte's repositories
optimum
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
text-generation-inference
Large Language Model Text Generation Inference
datasets
🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
transformers
🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.
FasterTransformer
Transformer related optimization, including BERT, GPT
llm-foundry
LLM training code for MosaicML foundation models
Open-Assistant
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
dotfiles
My dotfiles for syncing and sharing
t5-encoder
A extension of Transformers library to include T5ForSequenceClassification class.
label-shift
Label shift experiments in TensorFlow
bias-correction
Incremental bias correction in PyTorch
bert-vis
Visualizing word sense and domain shift in BERT representations
serving
A flexible, high-performance serving system for machine learning models
hermit-packages
Hermit manages isolated, self-bootstrapping sets of tools in software projects.
hermit
Hermit manages isolated, self-bootstrapping sets of tools in software projects.
text
Making text a first-class citizen in TensorFlow.
tensorflow
An Open Source Machine Learning Framework for Everyone
jax
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
io
Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO
tink
Tink is a multi-language, cross-platform, open source library that provides cryptographic APIs that are secure, easy to use correctly, and hard(er) to misuse.
mlflow
Open source platform for the machine learning lifecycle
blocks
Simple interface to read, organize, and manipulate structured data in files on local and cloud storage
estimator
TensorFlow Estimator
sparseml
Libraries and state-of-the-art automatic sparsification algorithms to simplify and accelerate performance
sparsify
Easy-to-use autoML interface to optimize deep neural networks for better inference performance and a smaller footprint.
pandas-malloc-benchmark
Optimizing Pandas DataFrame memory allocation