AI-Mou's repositories
prompttools
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
unsloth
80% faster 50% less memory LLM finetuning
rags
Build ChatGPT over your data, all with natural language
lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
XAgent
An Autonomous LLM Agent for Complex Task Solving
Awesome-LLM-Inference
💻A small Collection for Awesome LLM Inference [Papers|Blogs|Docs] with codes, contains TensorRT-LLM, streaming-llm, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
llamafile
Distribute and run LLMs with a single file.
OpenAgents
OpenAgents: An Open Platform for Language Agents in the Wild
DeepSeek-LLM
DeepSeek LLM: Let there be answers
meditron
Meditron is a suite of open-source medical Large Language Models (LLMs).
incubator-streampark
StreamPark, Make stream processing easier! easy-to-use streaming application development framework and operation platform
GeneralAgent
A simple, general, customizable Agent Framework
tokenization
A comprehensive deep dive into the world of tokens
nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
lm-format-enforcer
Enforce the output format (JSON Schema, Regex etc) of a language model
llmware
Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.
DeepSpeedExamples
Example models using DeepSpeed
llm-engine
Scale LLM Engine public repository
system-design-101
Explain complex systems using visuals and simple terms. Help you prepare for system design interviews.
Yuan-2.0
Yuan 2.0 Large Language Model
buddy-mlir
An MLIR-based compiler framework bridges DSLs (domain-specific languages) to DSAs (domain-specific architectures).
Fooocus
Focus on prompting and generating
generative-ai-for-beginners
12 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/
llm-universe
本项目是一个面向小白开发者的大模型应用开发教程，在线阅读地址：https://datawhalechina.github.io/llm-universe/
intel-extension-for-transformers
⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
evidence
Business intelligence as code: build polished reports with SQL and markdown
llama-recipes
Examples and recipes for Llama 2 model
RoboGen
A generative and self-guided robotic agent that endlessly propose and master new skills.