llama

There are 96 repositories under llama topic.

ollama / ollama
Get up and running with Llama 3, Mistral, Gemma, and other large language models.
go golang llama llama2 llm llms mistral ollama
Language:Go 66814
llama.cpp
ggerganov / llama.cpp
LLM inference in C/C++
ggml llama
Language:C++ 58272
chatchat-space / Langchain-Chatchat
Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM) QA app with langchain
chatbot chatchat chatglm chatglm-6b chatglm2-6b chatgpt embedding faiss fastchat gpt knowledge-base langchain langchain-chatchat langchain-chatglm llama llm milvus pgvector streamlit text2vec
Language:Python 28024
LLaMA-Factory
hiyouga / LLaMA-Factory
Unify Efficient Fine-Tuning of 100+ LLMs
agent ai chatglm fine-tuning gpt instruction-tuning language-model large-language-models llama llama3 llm lora mistral moe peft qlora quantization qwen rlhf transformers
Language:Python 22139
LocalAI
mudler / LocalAI
:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.
llama rwkv ai llm stable-diffusion api kubernetes gpt4all falcon tts coqui musicgen mamba audio-generation image-generation text-generation gemma mistral llama3 rerank
Language:C++ 20344
vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt llm pytorch llmops mlops model-serving transformer llm-serving inference llama amd rocm cuda inferentia trainium
Language:Python 19532
Chinese-LLaMA-Alpaca
ymcui / Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
alpaca alpaca-2 large-language-models llama llama-2 llm lora nlp plm pre-trained-language-models quantization
Language:Python 17537
haotian-liu / LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
gpt-4 chatbot chatgpt llama multimodal llava foundation-models instruction-tuning multi-modality visual-language-learning llama-2 llama2 vision-language-model
Language:Python 16714
GaiZhenbiao / ChuanhuChatGPT
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
chatbot chatgpt-api chatglm claude dalle3 ernie gemini gemma llama midjourney minimax moss ollama qwen spark stablelm inspurai
Language:Python 14823
cocktailpeanut / dalai
The simplest way to run LLaMA on your local machine
ai llama llm
Language:CSS 13063
LlamaFamily / Llama-Chinese
Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用
llama llm llama3 finetune-llm pretraining
Language:Python 11978
PaddleNLP
PaddlePaddle / PaddleNLP
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
nlp embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine semantic-analysis sentiment-analysis neural-search uie document-intelligence compression llm distributed-training llama
Language:Python 11504
HqWu-HITCS / Awesome-Chinese-LLM
整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。
llm nlp chatglm chinese llama awesome-lists
11412
ludwig
ludwig-ai / ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
deep-learning deeplearning deep learning machine-learning machinelearning natural-language-processing natural-language computer-vision data-centric data-science pytorch neural-network ml llm llm-training fine-tuning llama mistral llama2
Language:Python 10859
getumbrel / llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
ai chatgpt gpt gpt-4 gpt4all llama llama-2 llama-cpp llama2 llamacpp llm localai openai self-hosted code-llama codellama
Language:TypeScript 10381
meta-llama / llama-recipes
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
ai finetuning langchain llama llama2 llm machine-learning python pytorch vllm
Language:Jupyter Notebook 9675
unslothai / unsloth
Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory
ai fine-tuning finetuning gemma llama llama2 llms lora mistral qlora
Language:Python 9619
bentoml / OpenLLM
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
llm llmops model-inference falcon fine-tuning stablelm llm-serving llama mpt vicuna bentoml llama2 llm-inference llm-ops open-source-llm openllm ai mistral ml mlops
Language:Python 8927
bigscience-workshop / petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
bloom deep-learning distributed-systems language-models large-language-models machine-learning neural-networks pytorch volunteer-computing pipeline-parallelism tensor-parallelism guanaco llama chatbot gpt transformer nlp pretrained-models llama2 falcon
Language:Python 8730
TheR1D / shell_gpt
A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.
cheat-sheet cli gpt-3 openai productivity shell chatgpt python terminal linux commands gpt-4 llm llama ollama
Language:Python 8402
LianjiaTech / BELLE
BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
bloom instruction-set llama open-models gpt-q instruct-gpt gpt-evaluation chinese-nlp lora instruct-finetune
Language:HTML 7584
SJTU-IPADS / PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
falcon large-language-models llama llm llm-inference local-inference bamboo-7b
Language:C++ 7000
Chinese-LLaMA-Alpaca-2
ymcui / Chinese-LLaMA-Alpaca-2
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
64k alpaca alpaca-2 alpaca2 flash-attention large-language-models llama llama-2 llama2 llm nlp rlhf yarn
Language:Python 6908
zilliztech / GPTCache
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
aigc autogpt babyagi chatbot chatgpt chatgpt-api dolly gpt langchain llama llama-index llm memcache milvus openai redis semantic-search similarity-search vector-search
Language:Python 6480
reorproject / reor
Private & local AI personal knowledge management app.
ai lancedb llama llamacpp local-first markdown note-taking pkm vector-database rag second-brain ollama
Language:TypeScript 5990
baichuan-inc / Baichuan-7B
A large-scale 7B pretraining language model developed by BaiChuan-Inc.
artificial-intelligence ceval chatgpt chinese gpt-4 huggingface large-language-models llama mmlu natural-language-processing
Language:Python 5646
serge
serge-chat / serge
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
llama alpaca docker fastapi llamacpp python web svelte sveltekit tailwindcss nginx
Language:Svelte 5565
k8sgpt-ai / k8sgpt
Giving Kubernetes Superpowers to everyone
devops kubernetes openai sre tooling ai llama
Language:Go 4970
yangjianxin1 / Firefly
Firefly: 大模型训练工具，支持训练Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
gpt alpaca llm baichuan llama lora qlora peft llama2 internlm chatglm qwen xverse aquila mistral mixtral zephyr minicpm gemma llama3
Language:Python 4801
SCIR-HI / Huatuo-Llama-Med-Chinese
Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调
llama llm medical nlp aidoctor medgpt medqa chinese bloom huozi
Language:Python 4304
Facico / Chinese-Vicuna
Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca
alpaca chinese llama vicuna
Language:C 4136
Instruction-Tuning-with-GPT-4 / GPT-4-LLM
Instruction Tuning with GPT-4
alpaca chatgpt gpt-4 instruction-tuning llama
Language:HTML 4001
arcee-ai / mergekit
Tools for merging pretrained large language models.
llama llm model-merging
Language:Python 3658
h2oai / h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/
ai chatbot chatgpt fine-tuning finetuning generative generative-ai gpt llama llama2 llm llm-training
Language:Python 3635
langchain4j / langchain4j
Java version of LangChain
huggingface java langchain openai chatgpt gpt llama milvus pinecone weaviate onnx embeddings vector-database chroma gemini ollama anthropic openai-api pgvector
Language:Java 3357
lyogavin / Anima
33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
chinese-nlp finetune generative-ai instruct-gpt instruction-set llama llm lora open-models open-source open-source-models qlora chinese-llm
Language:Jupyter Notebook 3291

llama

ollama / ollama

ggerganov / llama.cpp

chatchat-space / Langchain-Chatchat

hiyouga / LLaMA-Factory

mudler / LocalAI

vllm-project / vllm

ymcui / Chinese-LLaMA-Alpaca

haotian-liu / LLaVA

GaiZhenbiao / ChuanhuChatGPT

cocktailpeanut / dalai

LlamaFamily / Llama-Chinese

PaddlePaddle / PaddleNLP

HqWu-HITCS / Awesome-Chinese-LLM

ludwig-ai / ludwig

getumbrel / llama-gpt

meta-llama / llama-recipes

unslothai / unsloth

bentoml / OpenLLM

bigscience-workshop / petals

TheR1D / shell_gpt

LianjiaTech / BELLE

SJTU-IPADS / PowerInfer

ymcui / Chinese-LLaMA-Alpaca-2

zilliztech / GPTCache

reorproject / reor

baichuan-inc / Baichuan-7B

serge-chat / serge

k8sgpt-ai / k8sgpt

yangjianxin1 / Firefly

SCIR-HI / Huatuo-Llama-Med-Chinese

Facico / Chinese-Vicuna

Instruction-Tuning-with-GPT-4 / GPT-4-LLM

arcee-ai / mergekit

h2oai / h2o-llmstudio

langchain4j / langchain4j

lyogavin / Anima