llama

There are 156 repositories under llama topic.

ollama / ollama
Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
deepseek gemma gemma3 gemma3n go golang gpt-oss llama llama2 llama3 llava llm llms mistral ollama phi4 qwen
Language:Go 152347
llama.cpp
ggml-org / llama.cpp
LLM inference in C/C++
ggml
Language:C++ 86509
LLaMA-Factory
hiyouga / LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
fine-tuning llama llm peft transformers rlhf qlora quantization qwen instruction-tuning gpt lora large-language-models agent ai moe llama3 deepseek gemma nlp
Language:Python 58292
vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt llm pytorch llmops mlops model-serving transformer llm-serving inference llama amd rocm cuda inferentia trainium tpu xpu hpu deepseek qwen
Language:Python 58069
unsloth
unslothai / unsloth
Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.
agent ai deepseek deepseek-r1 fine-tuning gemma gemma3 gpt-oss llama llama3 llm llms lora mistral openai qwen qwen3 text-to-speech tts unsloth
Language:Python 45475
aider
Aider-AI / aider
aider is AI pair programming in your terminal
chatgpt cli command-line gpt-4 openai gpt-3 gpt-35-turbo claude-3 gpt-4o anthropic gemini llama sonnet
Language:Python 37435
chatchat-space / Langchain-Chatchat
Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
chatglm langchain llm knowledge-base llama chatbot chatgpt embedding faiss fastchat gpt milvus streamlit chatchat langchain-chatglm qwen rag retrieval-augmented-generation xinference ollama
Language:TypeScript 36087
LocalAI
mudler / LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
llama rwkv ai llm stable-diffusion api kubernetes gpt4all tts musicgen mamba audio-generation image-generation text-generation gemma mistral llama3 rerank distributed libp2p
Language:Go 35288
haotian-liu / LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
gpt-4 chatbot chatgpt llama multimodal llava foundation-models instruction-tuning multi-modality visual-language-learning llama-2 llama2 vision-language-model
Language:Python 23544
fishaudio / fish-speech
SOTA Open Source TTS
llama transformer tts valle vits vqgan vqvae
Language:Python 22926
HqWu-HITCS / Awesome-Chinese-LLM
整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。
llm nlp chatglm chinese llama awesome-lists
21196
yamadashy / repomix
📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.
ai llm generative-ai chatgpt claude developer-tools chatbot gpt openai javascript nodejs typescript anthropic gemini language-model artificial-intelligence genai deepseek llama mcp
Language:TypeScript 19203
Chinese-LLaMA-Alpaca
ymcui / Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
llm plm pre-trained-language-models alpaca llama nlp quantization large-language-models lora alpaca-2 llama-2
Language:Python 18920
sgl-project / sglang
SGLang is a fast serving framework for large language models and vision language models.
cuda inference llama llava llm llm-serving moe pytorch transformer vlm llama3 deepseek deepseek-v3 deepseek-r1 qwen3 llama4 blackwell openai kimi gpt-oss
Language:Python 17925
meta-llama / llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
ai finetuning langchain llama llama2 llm machine-learning python pytorch vllm
Language:Jupyter Notebook 17851
GaiZhenbiao / ChuanhuChatGPT
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
chatbot chatgpt-api chatglm claude dalle3 ernie gemini gemma llama midjourney minimax moss ollama qwen spark stablelm inspurai
Language:Python 15437
LlamaFamily / Llama-Chinese
Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用
agent llama llama4 llm pretraining rl
Language:Python 14539
cocktailpeanut / dalai
The simplest way to run LLaMA on your local machine
ai llama llm
Language:CSS 13081
PaddleNLP
PaddlePaddle / PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
nlp embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine semantic-analysis sentiment-analysis neural-search uie document-intelligence compression llm distributed-training llama
Language:Python 12762
AstrBotDevs / AstrBot
✨ 一站式 LLM 聊天机器人平台及开发框架 ✨ 支持 QQ、QQ频道、Telegram、企微、飞书、钉钉 | 知识库、MCP 服务器、OpenAI、DeepSeek、Gemini、硅基流动、月之暗面、Ollama、OneAPI、Dify
ai chatbot chatgpt openai qqbot qqchannel gpt qq agent docker llm python telegram gemini llama mcp
Language:Python 12095
bentoml / OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna
Language:Python 11776
ludwig
ludwig-ai / ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
deep-learning deeplearning deep learning machine-learning machinelearning natural-language-processing natural-language computer-vision data-centric data-science pytorch neural-network ml llm llm-training fine-tuning llama mistral llama2
Language:Python 11584
TheR1D / shell_gpt
A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.
cheat-sheet cli gpt-3 openai productivity shell chatgpt python terminal linux commands gpt-4 llm llama ollama
Language:Python 11341
getumbrel / llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
ai chatgpt gpt gpt-4 gpt4all llama llama-2 llama-cpp llama2 llamacpp llm localai openai self-hosted code-llama codellama
Language:TypeScript 11001
modelscope / ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, GLM4.5, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, InternVL3.5, Ovis2.5, Llava, GLM4v, Phi4, ...) (AAAI 2025).
llm lora llama sft deploy multimodal peft internvl liger qwen2-vl rft deepseek-r1 embedding grpo open-r1 megatron omni llama4 qwen3 qwen3-moe
Language:Python 9869
bigscience-workshop / petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
bloom deep-learning distributed-systems language-models large-language-models machine-learning neural-networks pytorch volunteer-computing pipeline-parallelism tensor-parallelism guanaco llama chatbot gpt transformer nlp pretrained-models falcon mixtral
Language:Python 9791
dataelement / bisheng
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.
agent ai chatbot rag workflow enterprise genai gpt langchian llama llm llmdevops llmops ocr openai orchestration python react finetune sft
Language:TypeScript 9631
langchain4j / langchain4j
LangChain4j is an open-source Java library that simplifies the integration of LLMs into Java applications through a unified API, providing access to popular LLMs and vector databases. It makes implementing RAG, tool calling (including support for MCP), and agents easy. LangChain4j integrates seamlessly with various enterprise Java frameworks.
huggingface java langchain openai chatgpt gpt llama milvus pinecone onnx embeddings vector-database chroma gemini ollama anthropic openai-api pgvector llm llms
Language:Java 8996
xorbitsai / inference
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
ggml pytorch chatglm deployment flan-t5 llm wizardlm artificial-intelligence machine-learning whisper inference openai-api mistral gemma llama llamacpp vllm qwen llama3 glm4
Language:Python 8525
SJTU-IPADS / PowerInfer
High-speed Large Language Model Serving for Local Deployment
large-language-models llama llm llm-inference local-inference
Language:C++ 8330
reorproject / reor
Private & local AI personal knowledge management app for high entropy people.
ai lancedb llama llamacpp local-first markdown note-taking ollama pkm rag second-brain vector-database
Language:JavaScript 8249
LianjiaTech / BELLE
BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
bloom instruction-set llama open-models gpt-q instruct-gpt gpt-evaluation chinese-nlp lora instruct-finetune
Language:HTML 8226
LostRuins / koboldcpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
koboldcpp llamacpp llm koboldai llama ggml gguf gemma language-model mistral
Language:C++ 8193
zilliztech / GPTCache
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
chatbot chatgpt chatgpt-api llm milvus similarity-search vector-search aigc openai memcache gpt langchain autogpt redis babyagi llama-index llama dolly semantic-search
Language:Python 7765
Chinese-LLaMA-Alpaca-2
ymcui / Chinese-LLaMA-Alpaca-2
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
64k alpaca alpaca-2 alpaca2 flash-attention large-language-models llama llama-2 llama2 llm nlp rlhf yarn
Language:Python 7176
k8sgpt-ai / k8sgpt
Giving Kubernetes Superpowers to everyone
ai devops kubernetes llama openai sre tooling
Language:Go 6948

llama

ollama / ollama

ggml-org / llama.cpp

hiyouga / LLaMA-Factory

vllm-project / vllm

unslothai / unsloth

Aider-AI / aider

chatchat-space / Langchain-Chatchat

mudler / LocalAI

haotian-liu / LLaVA

fishaudio / fish-speech

HqWu-HITCS / Awesome-Chinese-LLM

yamadashy / repomix

ymcui / Chinese-LLaMA-Alpaca

sgl-project / sglang

meta-llama / llama-cookbook

GaiZhenbiao / ChuanhuChatGPT

LlamaFamily / Llama-Chinese

cocktailpeanut / dalai

PaddlePaddle / PaddleNLP

AstrBotDevs / AstrBot

bentoml / OpenLLM

ludwig-ai / ludwig

TheR1D / shell_gpt

getumbrel / llama-gpt

modelscope / ms-swift

bigscience-workshop / petals

dataelement / bisheng

langchain4j / langchain4j

xorbitsai / inference

SJTU-IPADS / PowerInfer

reorproject / reor

LianjiaTech / BELLE

LostRuins / koboldcpp

zilliztech / GPTCache

ymcui / Chinese-LLaMA-Alpaca-2

k8sgpt-ai / k8sgpt