mahdip72

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

protein-structure-tokenizer

Official implementation of "Learning the language of protein structures"

ProteinWorkshop

Benchmarking framework for protein representation learning. Includes a large number of pre-training and downstream task datasets, models and training/task utilities. (ICLR 2024)

llama-models

Utilities intended for use with Llama models.

ttt-lm-pytorch

Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

schedule_free

Schedule-Free Optimization in PyTorch

mergekit

Tools for merging pretrained large language models.

ProSST

Code for ProSST: A Pre-trained Protein Sequence and Structure Transformer with Disentangled Attention.

esm

ml-4m

4M: Massively Multimodal Masked Modeling

LLM101n

LLM101n: Let's build a Storyteller

Uni-Mol

Official Repository for the Uni-Mol Series Methods

nablaDFT

nablaDFT: Large-Scale Conformational Energy and Hamiltonian Prediction benchmark and dataset

magvit

Official JAX implementation of MAGVIT: Masked Generative Video Transformer

MathBlackBox

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

chroma

A generative model for programmable protein design

alphafold3-pytorch

Implementation of Alphafold 3 in Pytorch

magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

En-transformer

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-Equivariant Graph Neural Network

egnn-pytorch

Implementation of E(n)-Equivariant Graph Neural Networks, in Pytorch

equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and adopted for use by EquiFold for protein folding

COATI

COATI: multi-modal contrastive pre-training for representing and traversing chemical space

matmulfreellm

Implementation for MatMul-free LM.

matchem-llm

A public repository collecting links to state of the art QA and evaluation sets for various ML and LLM applications

LlamaGen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

se3-transformer-public

code for the SE3 Transformers paper: https://arxiv.org/abs/2006.10503

se3-transformer-pytorch

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Torch-Linguist

Language Modeling with PyTorch