merrymercy

awesome-tensor-compilers

A list of awesome compiler projects and papers for tensor computation and deep learning.

Awesome-Efficient-LLM

A curated list for Efficient Large Language Models

tvm

End to end Tensor IR/DSL stack for deploying deep learning workloads to hardwares

Awesome-LLM-System-Papers

Wolf-Killer

Werewolf, a board game

chain-of-thought-hub

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting

instruct-eval

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

ao

PyTorch native quantization and sparsity for training and inference

dtr-prototype

Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616

FlexFlow

A distributed deep learning framework that supports flexible parallelization strategies.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

tensorflow

An Open Source Machine Learning Framework for Everyone

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Virgo

alpa

Training and serving large-scale neural networks

blpa

Backprop with Low-Precision Activations

dspy

Stanford DSPy: The framework for programming—not prompting—foundation models

flashinfer

FlashInfer: Kernel Library for LLM Serving

gnark-crypto

gnark-crypto provides elliptic curve and pairing-based cryptography on BN, BLS12, BLS24 and BW6 curves. It also provides various algorithms (algebra, crypto) of particular interest to zero knowledge proof systems.

human-eval

Code for the paper "Evaluating Large Language Models Trained on Code"

jax

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

merrymercy

Config files for my GitHub profile.

merrymercy.github.io

personal website

mesh

Mesh TensorFlow: Model Parallelism Made Easier

MONeT

MONeT framework for reducing memory consumption of DNN training

outlines

Structured Text Generation

r1cs-tutorial

Tutorial for writing constraints in the `arkworks` framework

torch-int

This repository contains integer operators on GPUs for PyTorch.

worker-sglang

SGLang is yet another fast serving framework for large language models and vision language models.