language-model

There are 185 repositories under language-model topic.

generative-ai-for-beginners
microsoft / generative-ai-for-beginners
21 Lessons, Get Started Building with Generative AI
ai chatgpt dall-e generativeai gpt azure generative-ai llms openai prompt-engineering language-model semantic-search transformers microsoft-for-beginners
Language:Jupyter Notebook 101590
LLMs-from-scratch
rasbt / LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
ai artificial-intelligence chatbot chatgpt deep-learning from-scratch generative-ai gpt language-model large-language-models llm machine-learning neural-networks python pytorch transformers
Language:Jupyter Notebook 78364
dair-ai / Prompt-Engineering-Guide
🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
agent agents ai-agents chatgpt deep-learning generative-ai language-model llms openai prompt-engineering rag
Language:MDX 66228
gpt4free
xtekky / gpt4free
The official gpt4free repository | various collection of powerful language models | o4, o3 and deepseek r1, gpt-4.1, gemini 2.5
chatbot chatbots chatgpt chatgpt-4 chatgpt-api chatgpt-free chatgpt4 deepseek deepseek-api deepseek-r1 gpt gpt-4 gpt-4o gpt4 gpt4-api language-model openai openai-api openai-chatgpt reverse-engineering
Language:Python 65509
LAION-AI / Open-Assistant
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
ai assistant chatgpt discord-bot language-model machine-learning nextjs python rlhf
Language:Python 37491
tatsu-lab / stanford_alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
deep-learning instruction-following language-model
Language:Python 30213
mlc-ai / mlc-llm
Universal LLM Deployment Engine with ML Compilation
language-model llm machine-learning-compilation tvm
Language:Python 21587
yamadashy / repomix
📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.
ai llm generative-ai chatgpt claude developer-tools chatbot gpt openai javascript nodejs typescript anthropic gemini language-model artificial-intelligence genai deepseek llama mcp
Language:TypeScript 20137
ai
vercel / ai
The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
anthropic artificial-intelligence gemini generative-ai generative-ui javascript language-model llm nextjs openai react svelte typescript vercel vue
Language:TypeScript 19201
arc53 / DocsGPT
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
agent-builder agents ai chatgpt docsgpt hacktoberfest hacktoberfest2025 information-retrieval language-model llm machine-learning natural-language-processing python pytorch rag react search semantic-search transformers
Language:Python 17349
mlc-ai / web-llm
High-performance In-browser LLM Inference Engine
chatgpt deep-learning language-model llm tvm webgpu webml
Language:TypeScript 16769
BlinkDL / RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
attention-mechanism chatgpt deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn rwkv transformer transformers
Language:Python 14116
mlfoundations / open_clip
An open source implementation of CLIP.
computer-vision contrastive-loss deep-learning language-model multi-modal-learning pretrained-models pytorch zero-shot-classification
Language:Python 12916
microsoft / LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
adaptation deberta deep-learning gpt-2 gpt-3 language-model lora low-rank pytorch roberta
Language:Python 12913
txtai
neuml / txtai
💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows
python search machine-learning nlp semantic-search vector-search txtai llm vector-database language-model transformers sentence-embeddings large-language-models information-retrieval search-engine embeddings retrieval-augmented-generation rag ai artificial-intelligence
Language:Python 11803
speechbrain / speechbrain
A PyTorch-based Speech Toolkit
asr audio audio-processing deep-learning huggingface language-model pytorch speaker-diarization speaker-recognition speaker-verification speech-enhancement speech-processing speech-recognition speech-separation speech-to-text speech-toolkit speechrecognition spoken-language-understanding transformers voice-recognition
Language:Python 10758
EleutherAI / lm-evaluation-harness
A framework for few-shot evaluation of language models.
evaluation-framework language-model transformer
Language:Python 10580
tokenizers
huggingface / tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
bert gpt language-model natural-language-processing natural-language-understanding nlp transformers
Language:Rust 10210
brightmart / nlp_chinese_corpus
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
bert chinese chinese-corpus chinese-dataset chinese-nlp corpus dataset language-model news nlp pretrain question-answering text-classification wiki word2vec
9806
BlinkDL / ChatRWKV
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
chatbot chatgpt language-model pytorch rnn rwkv
Language:Python 9511
LostRuins / koboldcpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
gemma ggml gguf koboldai koboldcpp language-model llama llamacpp llm mistral
Language:C++ 8869
OptimalScale / LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
chatgpt deep-learning instruction-following language-model pretrained-models pytorch transformer
Language:Python 8479
EleutherAI / gpt-neo
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
gpt gpt-2 gpt-3 language-model transformers
Language:Python 8289
EleutherAI / gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
deepspeed-library gpt-3 transformers language-model
Language:Python 7330
OpenNMT / OpenNMT-py
Open Source Neural Machine Translation and (Large) Language Models in PyTorch
deep-learning pytorch machine-translation neural-machine-translation language-model llms
Language:Python 6966
zai-org / CogVLM
a state-of-the-art-level open visual language model | 多模态预训练模型
cross-modality language-model multi-modal pretrained-models visual-language-models
Language:Python 6691
codertimo / BERT-pytorch
Google AI 2018 BERT pytorch implementation
bert language-model nlp pytorch transformer
Language:Python 6494
aiwaves-cn / agents
An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents
autonomous-agents language-model llm
Language:Python 5757
ramon-victor / freegpt-webui
GPT 3.5/4 with a Chat Web UI. No API key required.
apifree chatgpt chatgpt-api chatgpt-clone gpt-4-api gpt-interface gpt3 gpt3-api gpt3-turbo gpt4 gpt4all gptfree jailbreak language-model website freegpt freegpt4 gpt-free gpt-4 gpt-4-free
Language:Python 5675
xlang-ai / OpenAgents
[COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild
llm code-generation executable-langauge-grounding language-model semantic-parsing language-model-agent hacktoberfest agent assistant-chat-bots gpt tool-learning ui
Language:Python 4603
yizhongw / self-instruct
Aligning pretrained language models with instruction data generated by themselves.
general-purpose-model language-model instruction-tuning
Language:Python 4519
huggingface / speech-to-speech
Speech To Speech: an effort for an open-sourced and modular GPT4-o
ai assistant language-model machine-learning python speech speech-synthesis speech-to-text speech-translation
Language:Python 4227
CLUEbenchmark / CLUE
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
nlu benchmark chinese corpus dataset bert albert chineseglue glue roberta language-model pretrained-models transformers tensorflow pytorch
Language:Python 4202
microsoft / LMOps
General technology for enabling AI capabilities w/ LLMs and MLLMs
nlp agi gpt llm lm pretraining prompt lmops promptist x-prompt language-model
Language:Python 4165
lmql
eth-sri / lmql
A language for constraint-guided and efficient LLM programming.
chatgpt huggingface language-model programming-language
Language:Python 4079
LLMBook-zh / LLMBook-zh.github.io
《大语言模型》作者：赵鑫，李军毅，周昆，唐天一，文继荣
artificial-intelligence deep-learning deep-neural-networks deep-reinforcement-learning fine-tuning language-model large-language-models natural-language-processing nlp pretrained-models
Language:Python 4076