codedecde

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

triton

Development repository for the Triton language and compiler

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

lm-evaluation-harness

A framework for few-shot evaluation of language models.

mup

maximal update parametrization (µP)

aiofiles

File support for asyncio

langchain

🦜🔗 Build context-aware reasoning applications

dacite

Simple creation of data classes from dictionaries.

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

volkswagen

:see_no_evil: Volkswagen detects when your tests are being run in a CI server, and makes them pass.

DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

py-spy

Sampling profiler for Python programs

RPA-Python

Python package for doing RPA

flash-attention

Fast and memory-efficient exact attention

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

LinkBERT

[ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links

ungoliant

:spider: The pipeline for the OSCAR corpus

infinibatch

Efficient, check-pointed data loading for deep learning with massive data sets.

blobfile

Read Google Cloud Storage, Azure Blobs, and local paths with the same interface

deduplicate-text-datasets

laserembeddings

LASER multilingual sentence embeddings as a pip package

deepmind-research

This repository contains implementations and illustrative code to accompany DeepMind publications

gpustat

📊 A simple command-line utility for querying and monitoring GPU status

DeOldify

A Deep Learning based project for colorizing and restoring old images (and video!)

streamlit

Streamlit — A faster way to build and share data apps.

loguru

Python logging made (stupidly) simple

python-fire

Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.

libact

Pool-based active learning in Python