transformers

There are 122 repositories under transformers topic.

generative-ai-for-beginners
microsoft / generative-ai-for-beginners
21 Lessons, Get Started Building with Generative AI
ai chatgpt dall-e generativeai gpt azure generative-ai llms openai prompt-engineering language-model semantic-search transformers microsoft-for-beginners
Language:Jupyter Notebook 97909
annotated_deep_learning_paper_implementations
labmlai / annotated_deep_learning_paper_implementations
🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
deep-learning deep-learning-tutorial pytorch gan transformers reinforcement-learning optimizers neural-networks transformer machine-learning attention literate-programming lora
Language:Python 63212
LLaMA-Factory
hiyouga / LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
fine-tuning llama llm peft transformers rlhf qlora quantization qwen instruction-tuning gpt lora large-language-models agent ai moe llama3 deepseek gemma nlp
Language:Python 58292
lucidrains / vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
artificial-intelligence attention-mechanism transformers computer-vision image-classification
Language:Python 23929
haystack
deepset-ai / haystack
AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
nlp question-answering pytorch semantic-search information-retrieval summarization transformers machine-learning ai python large-language-models generative-ai llm rag retrieval-augmented-generation agents agent gemini gpt-4 orchestration
Language:Python 22502
amusi / CVPR2025-Papers-with-Code
CVPR 2025 论文和开源项目合集
cvpr cvpr2020 computer-vision deep-learning machine-learning object-detection image-segmentation paper image-processing visual-tracking python cvpr2021 semantic-segmentation cvpr2022 transformer transformers cvpr2023 cvpr2024 cvpr2025
20889
huggingface / peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
adapter diffusion llm parameter-efficient-learning python pytorch transformers lora fine-tuning peft
Language:Python 19577
arc53 / DocsGPT
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
ai python natural-language-processing react chatgpt docsgpt information-retrieval language-model llm machine-learning pytorch rag semantic-search transformers hacktoberfest agent-builder agents search
Language:TypeScript 17075
stas00 / ml-engineering
Machine Learning Engineering Open Book
pytorch slurm large-language-models llm machine-learning scalability transformers machine-learning-engineering mlops ai inference training
Language:Python 15074
huggingface / transformers.js
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
browser javascript transformers webml
Language:JavaScript 14547
BlinkDL / RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
attention-mechanism deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn transformer transformers rwkv chatgpt
Language:Python 13969
NVIDIA / Megatron-LM
Ongoing research training transformer models at scale
large-language-models model-para transformers
Language:Python 13577
PaddleNLP
PaddlePaddle / PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
nlp embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine semantic-analysis sentiment-analysis neural-search uie document-intelligence compression llm distributed-training llama
Language:Python 12762
txtai
neuml / txtai
💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows
python search machine-learning nlp semantic-search vector-search txtai llm vector-database language-model transformers sentence-embeddings large-language-models information-retrieval search-engine embeddings retrieval-augmented-generation rag ai artificial-intelligence
Language:Python 11571
NielsRogge / Transformers-Tutorials
This repository contains demos I made with the Transformers library by HuggingFace.
bert gpt-2 layoutlm pytorch transformers vision-transformer
Language:Jupyter Notebook 11220
qubvel-org / segmentation_models.pytorch
Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.
segmentation image-processing pspnet unet unet-pytorch pytorch fpn models imagenet semantic-segmentation image-segmentation segmentation-models unetplusplus deeplabv3 deeplab-v3-plus pretrained-weights computer-vision segformer transformers dpt
Language:Python 10883
speechbrain / speechbrain
A PyTorch-based Speech Toolkit
speech-recognition speech-toolkit speaker-recognition speech-to-text speech-enhancement speech-separation audio audio-processing speech-processing speechrecognition asr voice-recognition spoken-language-understanding speaker-diarization speaker-verification pytorch huggingface transformers language-model deep-learning
Language:Python 10430
tokenizers
huggingface / tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
nlp natural-language-processing natural-language-understanding language-model transformers bert gpt
Language:Rust 10073
niedev / RTranslator
Open source real-time translation app for Android that runs locally
translator bluetooth-le realtime-translator android-app onnx onnxruntime sentencepiece transformers translation nllb whisper mobile-app android offline
Language:C++ 9152
openvinotoolkit / openvino
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
inference deep-learning openvino ai computer-vision diffusion-models generative-ai llm-inference natural-language-processing nlp performance-boost speech-recognition stable-diffusion deploy-ai optimize-ai transformers yolo recommendation-system good-first-issue
Language:C++ 8821
FoundationVision / VAR
[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!
auto-regressive-model diffusion-models image-generation transformers autoregressive-models generative-ai generative-model gpt gpt-2 large-language-models vision-transformer neurips
Language:Jupyter Notebook 8393
EleutherAI / gpt-neo
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
language-model transformers gpt gpt-2 gpt-3
Language:Python 8292
lucidrains / PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
artificial-intelligence attention-mechanisms deep-learning human-feedback reinforcement-learning transformers
Language:Python 7864
intel / ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
gpu llm pytorch transformers
Language:Python 7731
bertviz
jessevig / bertviz
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
natural-language-processing machine-learning visualization neural-network pytorch nlp bert transformer gpt2 roberta transformers
Language:Python 7638
EleutherAI / gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
deepspeed-library gpt-3 transformers language-model
Language:Python 7301
BERTopic
MaartenGr / BERTopic
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
bert transformers topic-modeling sentence-embeddings nlp machine-learning topic ldavis topic-modelling topic-models
Language:Python 6646
OpenRLHF / OpenRLHF
An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)
large-language-models openai-o1 proximal-policy-optimization raylib reinforcement-learning reinforcement-learning-from-human-feedback transformers vllm
Language:Python 6187
SkalskiP / courses
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
computer-vision deep-learning deep-neural-networks machine-learning mlops multimodal transformers tutorial natural-language-processing nlp generative-model stable-diffusion
Language:Python 6176
lucidrains / DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
artificial-intelligence attention-mechanism deep-learning multi-modal text-to-image transformers
Language:Python 5628
lucidrains / x-transformers
A concise but complete full-attention transformer with a set of promising experimental features from various papers
artificial-intelligence attention-mechanism deep-learning transformers
Language:Python 5572
OFA-Sys / Chinese-CLIP
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
chinese computer-vision multi-modal-learning nlp pytorch vision-and-language-pre-training image-text-retrieval clip pretrained-models vision-language deep-learning multi-modal contrastive-loss transformers coreml-models
Language:Jupyter Notebook 5507
imoneoi / openchat
OpenChat: Advancing Open-source Language Models with Imperfect Data
large-language-models open-source transformers
Language:Python 5321
superduper
superduper-io / superduper
Superduper: End-to-end framework for building custom AI applications and agents.
ai mlops torch transformers mongodb python pytorch ml database data inference distributed-ml llm-inference pretrained-models chatbot semantic-search llm-serving llmops vector-search rag
Language:Python 5208
alignment-handbook
huggingface / alignment-handbook
Robust recipes to align language models with human and AI preferences
llm rlhf transformers
Language:Python 5117
cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
attention-mechanism attention-mechanisms awesome-list computer-vision deep-learning detr papers self-attention transformer transformer-architecture transformer-awesome transformer-cv transformer-models transformer-with-cv transformers vision-transformer visual-transformer vit
4827