marsggbo

MoECache

Implement the expert cache for MoE

transformers-code

手把手带你实战 Huggingface Transformers 课程视频同步更新在B站与YouTube

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

oh-my-server

awesome-mixture-of-experts

A collection of AWESOME things about mixture-of-experts

nasbench

NASBench: A Neural Architecture Search Dataset and Benchmark

annotated_deep_learning_paper_implementations

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

alibi

PyTorch implementation of Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation

FLASHQuad_pytorch

FLASHQuad_pytorch

FasterTransformer

Transformer related optimization, including BERT, GPT

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

llama

Inference code for Llama models

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

pandallm

Panda项目是于2023年5月启动的开源海外中文大语言模型项目，致力于大模型时代探索整个技术栈，旨在推动中文自然语言处理领域的创新和合作。

awesome-llm-json

Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Diffusion-Models-pytorch

Pytorch implementation of Diffusion Models (https://arxiv.org/pdf/2006.11239.pdf)

Awesome-Healthcare-Foundation-Models

forked-pdb

Python pdb for multiple processes

lightning-Hivemind

Lightning Training strategy for HiveMind

awesome-chatgpt-prompts

This repo includes ChatGPT prompt curation to use ChatGPT better.

automl

Lectures and tutorials on Automated Machine Learning and Metalearning

bolei_awesome_posters

CVPR and NeurIPS poster examples and templates. May we have in-person poster session soon!

drawio-function-plot-plugin

Function Plot plugin for Draw.io Desktop.

awesome-active-learning

Everything you need about Active Learning (AL).

Cream

This is a collection of our NAS and Vision Transformer work.

hyperbox

https://hyperbox-doc.readthedocs.io/en/latest/