Neko9810

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

MAC

Online Adaptation of Language Models with a Memory of Amortized Contexts

open-instruct

ChatDev

Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)

tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Efficient-LLMs-Survey

[TMLR 2024] Efficient Large Language Models: A Survey

LongLoRA

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

LongChat

Official repository for LongChat and LongEval

LLM-Conversation-Safety

[NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey

ReAct

[ICLR 2023] ReAct: Synergizing Reasoning and Acting in Language Models

Evil-Geniuses

mamba

Mamba SSM architecture

distrifuser

[CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

PixArt-alpha

PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

BitNet

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

llama_parse

Parse files for optimal RAG

ring-flash-attention

Ring attention implementation with flash attention

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

faiss

A library for efficient similarity search and clustering of dense vectors.

chatgpt-retrieval-plugin

The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.

plugins-quickstart

Get a ChatGPT plugin up and running in under 5 minutes!

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

ringattention

Transformers with Arbitrarily Large Context

LWM

guided-diffusion

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

yet-another-applied-llm-benchmark

A benchmark to evaluate language models on questions I've previously asked them to solve.