JegernOUTT

gpt4all

gpt4all: run open-source LLMs anywhere

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

alpaca-lora

Instruct-tune LLaMA on consumer hardware

RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

shell_gpt

A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.

dinov2

PyTorch code and models for the DINOv2 self-supervised learning method.

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

DAMO-YOLO

DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.

GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ

Video-LLaMA

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

pythia

The hub for EleutherAI's work on interpretability and learning dynamics

lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

toolformer-pytorch

Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

kernl

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

CodeTF

CodeTF: One-stop Transformer Library for State-of-the-art Code LLM

X-Decoder

[CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language

Sophia

The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”

Adan

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

CodeT

recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

Youku-mPLUG

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks

refact-self-hosting

Refact.ai self-hosted server and Docker image

SeViLA

[NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering

guanaco-lora

Instruct-tune LLaMA on consumer hardware

FLAIR

deblatting_python

[IJCV 2021] Python implementation of deblatting

lexlms

LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development

MMET