RuiWang1998

llama

Inference code for Llama models

ControlNet

Let us control diffusion models!

numpy

The fundamental package for scientific computing with Python.

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

mamba

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

mistral-src

Reference implementation of Mistral AI 7B v0.1 model.

Baichuan-7B

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

cutlass

CUDA Templates for Linear Algebra Subroutines

s4

Structured state space sequence models

segment-anything-fast

A batched offline inference oriented version of segment-anything

tree

tree is a library for working with nested data structures

Sophia

The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”

opt_einsum

⚡️Optimizing einsum functions in NumPy, Tensorflow, Dask, and more with contraction order optimization.

OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

ColabDesign

Making Protein Design accessible to all via Google Colab!

dadaptation

D-Adaptation for SGD, Adam and AdaGrad

MS-AMP

Microsoft Automatic Mixed Precision Library

Sophia

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

ml-sigma-reparam

MiniFold

MiniFold: Deep Learning for Protein Structure Prediction inspired by DeepMind AlphaFold algorithm

Ankh

Ankh: Optimized Protein Language Model

float8_experimental

This repository contains the experimental PyTorch native float8 training UX

RoseTTAFold2

foldcomp

Compressing protein structures effectively with torsion angles

PEER_Benchmark

PEER Benchmark, appear at NeurIPS 2022 Dataset and Benchmark Track (https://arxiv.org/abs/2206.02096)

EATLM

Code for 'On Pre-trained Language Models For Antibody'

ProteinPretraining

Source code of PETA: Evaluating the Impact of Protein Transfer Learning with Sub-word Tokenization on Downstream Applications.

CASP15

CASP15 performance benchmarking of the state-of-the-art protein structure prediction methods