XHPlus

phidata

Build AI Assistants with memory, knowledge and tools.

ChatGPT-AutoExpert

🚀🧠💬 Supercharged Custom Instructions for ChatGPT (non-coding) and ChatGPT Advanced Data Analysis (coding).

llm-colosseum

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

llmc

This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit"

Awesome-Efficient-Diffusion

Curated list of methods that focuses on improving the efficiency of diffusion models

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

zstd

Zstandard - Fast real-time compression algorithm

EasyLLM

Built upon Megatron-Deepspeed and HuggingFace Trainer, EasyLLM has reorganized the code logic with a focus on usability. While enhancing usability, it also ensures training efficiency.

evo.ninja

A versatile generalist agent.

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Awesome-LLM-Reasoning

Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought, Instruction-Tuning and Multimodality.

S-LoRA

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

AISystem

AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

flash-llm

Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity

Outlier_Suppression_Plus

Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling

general-sam

A general suffix automaton implementation in Rust with Python bindings

fiftyone

The open-source tool for building high-quality datasets and computer vision models

encord-active

The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.

RealChar

🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI GPT3.5/4, Anthropic Claude2, Chroma Vector DB, Whisper Speech2Text, ElevenLabs Text2Speech🎙️🤖

GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

LPCV_2023_solution

RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

awesome-lm-system

Summary of system papers/frameworks/codes/tools on training or serving large model

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Dipoorlet

Offline Quantization Tools for Deploy.

resume

An elegant \LaTeX\ résumé template. 大陆镜像 https://gods.coding.net/p/resume/git

QDrop

The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization

triton

Development repository for the Triton language and compiler

AAAI2023_EAMPD

AAAI2023 Efficient and Accurate Models towards Practical Deep Learning Baseline

NART

NART = NART is not A RunTime, a deep learning inference framework.