transformers

There are 88 repositories under transformers topic.

annotated_deep_learning_paper_implementations
labmlai / annotated_deep_learning_paper_implementations
🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
attention deep-learning deep-learning-tutorial gan literate-programming machine-learning neural-networks optimizers pytorch reinforcement-learning transformer transformers
Language:Jupyter Notebook 48764
generative-ai-for-beginners
microsoft / generative-ai-for-beginners
18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/
ai azure chatgpt dall-e generative-ai generativeai gpt language-model llms openai prompt-engineering semantic-search transformers
Language:Jupyter Notebook 43581
LLaMA-Factory
hiyouga / LLaMA-Factory
Unify Efficient Fine-Tuning of 100+ LLMs
agent ai chatglm fine-tuning gpt instruction-tuning language-model large-language-models llama llama3 llm lora mistral moe peft qlora quantization qwen rlhf transformers
Language:Python 21510
lucidrains / vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
artificial-intelligence attention-mechanism computer-vision image-classification transformers
Language:Python 18158
amusi / CVPR2024-Papers-with-Code
CVPR 2024 论文和开源项目合集
cvpr cvpr2020 computer-vision deep-learning machine-learning object-detection image-segmentation paper image-processing visual-tracking python cvpr2021 semantic-segmentation cvpr2022 transformer transformers cvpr2023 cvpr2024
16255
huggingface / peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
adapter diffusion llm lora parameter-efficient-learning python pytorch transformers
Language:Python 13985
haystack
deepset-ai / haystack
:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
nlp question-answering bert language-model pytorch semantic-search squad information-retrieval summarization transformers machine-learning ai python chatgpt gpt-3 large-language-models generative-ai
Language:Python 13785
BlinkDL / RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
attention-mechanism chatgpt deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn rwkv transformer transformers
Language:Python 11715
PaddleNLP
PaddlePaddle / PaddleNLP
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
bert compression distributed-training document-intelligence embedding ernie information-extraction llama llm neural-search nlp paddlenlp pretrained-models question-answering search-engine semantic-analysis sentiment-analysis transformers uie
Language:Python 11481
stas00 / ml-engineering
Machine Learning Engineering Open Book
ai large-language-models llm machine-learning machine-learning-engineering mlops pytorch scalability slurm transformers
Language:Python 9880
NVIDIA / Megatron-LM
Ongoing research training transformer models at scale
large-language-models model-para transformers
Language:Python 8733
tokenizers
huggingface / tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
bert gpt language-model natural-language-processing natural-language-understanding nlp transformers
Language:Rust 8492
EleutherAI / gpt-neo
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
gpt gpt-2 gpt-3 language-model transformers
Language:Python 8150
speechbrain / speechbrain
A PyTorch-based Speech Toolkit
asr audio audio-processing deep-learning huggingface language-model pytorch speaker-diarization speaker-recognition speaker-verification speech-enhancement speech-processing speech-recognition speech-separation speech-to-text speech-toolkit speechrecognition spoken-language-understanding transformers voice-recognition
Language:Python 7935
NielsRogge / Transformers-Tutorials
This repository contains demos I made with the Transformers library by HuggingFace.
transformers pytorch bert vision-transformer layoutlm gpt-2
Language:Jupyter Notebook 7850
xenova / transformers.js
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
browser javascript transformers webml
Language:JavaScript 7701
lucidrains / PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
artificial-intelligence attention-mechanisms deep-learning human-feedback reinforcement-learning transformers
Language:Python 7600
txtai
neuml / txtai
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
embeddings information-retrieval language-model large-language-models llm machine-learning neural-search nlp python rag retrieval-augmented-generation search search-engine semantic-search sentence-embeddings transformers txtai vector-database vector-search vector-search-engine
Language:Python 7071
EleutherAI / gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
deepspeed-library gpt-3 language-model transformers
Language:Python 6610
bertviz
jessevig / bertviz
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
bert gpt2 machine-learning natural-language-processing neural-network nlp pytorch roberta transformer transformers visualization
Language:Python 6415
intel-analytics / ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, etc.
gpu llm pytorch transformers
Language:Python 6033
openvinotoolkit / openvino
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
inference deep-learning openvino ai computer-vision diffusion-models generative-ai llm-inference natural-language-processing nlp performance-boost speech-recognition stable-diffusion deploy-ai optimize-ai transformers yolo recommendation-system good-first-issue
Language:C++ 5999
BERTopic
MaartenGr / BERTopic
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
bert transformers topic-modeling sentence-embeddings nlp machine-learning topic ldavis topic-modelling topic-models
Language:Python 5608
lucidrains / DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
artificial-intelligence attention-mechanism deep-learning multi-modal text-to-image transformers
Language:Python 5497
imoneoi / openchat
OpenChat: Advancing Open-source Language Models with Imperfect Data
large-language-models open-source transformers
Language:Python 4985
SkalskiP / courses
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
computer-vision deep-learning deep-neural-networks machine-learning mlops multimodal transformers tutorial natural-language-processing nlp generative-model stable-diffusion
Language:Python 4562
superduperdb
SuperDuperDB / superduperdb
🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
ai mlops torch transformers mongodb python pytorch ml database data inference distributed-ml llm-inference pretrained-models chatbot semantic-search llm-serving llmops vector-search rag
Language:Python 4388
lucidrains / deep-daze
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
artificial-intelligence deep-learning implicit-neural-representation multi-modality siren text-to-image transformers
Language:Python 4384
cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
transformer attention-mechanism vision-transformer deep-learning awesome-list transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer computer-vision papers attention-mechanisms self-attention vit detr transformers
4271
bentrevett / pytorch-sentiment-analysis
Tutorials on getting started with PyTorch and TorchText for sentiment analysis.
pytorch sentiment-analysis tutorial rnn lstm fasttext torchtext sentiment-classification cnn cnn-text-classification lstm-sentiment-analysis pytorch-tutorial pytorch-tutorials pytorch-nlp nlp natural-language-processing recurrent-neural-networks word-embeddings transformers bert
Language:Jupyter Notebook 4247
lucidrains / x-transformers
A simple but complete full-attention transformer with a set of promising experimental features from various papers
artificial-intelligence attention-mechanism deep-learning transformers
Language:Python 4179
trigaten / Learn_Prompting
Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community
chatgpt chatgpt-api deep-learning gpt-3 gpt-4 gpt-4-api gpt3 large-language-models llm machine-learning nlp openai-api prompt-engineering prompt-toolkit prompt-tuning prompting transformers
Language:MDX 4174
marqo
marqo-ai / marqo
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
chatgpt clip deep-learning gpt hacktoberfest hnsw information-retrieval knn large-language-models machine-learning machinelearning multi-modal natural-language-processing search-engine semantic-search tensor-search transformers vector-search vision-language visual-search
Language:Python 4167
simpletransformers
ThilinaRajapakse / simpletransformers
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
transformers text-classification named-entity-recognition question-answering conversational-ai information-retrival
Language:Python 3993
Fengshenbang-LM
IDEA-CCNL / Fengshenbang-LM
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。
aigc chinese-nlp distributed-training multimodal pretrained-models pytorch transformers
Language:Python 3904
alignment-handbook
huggingface / alignment-handbook
Robust recipes to align language models with human and AI preferences
llm rlhf transformers
Language:Python 3869

transformers

labmlai / annotated_deep_learning_paper_implementations

microsoft / generative-ai-for-beginners

hiyouga / LLaMA-Factory

lucidrains / vit-pytorch

amusi / CVPR2024-Papers-with-Code

huggingface / peft

deepset-ai / haystack

BlinkDL / RWKV-LM

PaddlePaddle / PaddleNLP

stas00 / ml-engineering

NVIDIA / Megatron-LM

huggingface / tokenizers

EleutherAI / gpt-neo

speechbrain / speechbrain

NielsRogge / Transformers-Tutorials

xenova / transformers.js

lucidrains / PaLM-rlhf-pytorch

neuml / txtai

EleutherAI / gpt-neox

jessevig / bertviz

intel-analytics / ipex-llm

openvinotoolkit / openvino

MaartenGr / BERTopic

lucidrains / DALLE-pytorch

imoneoi / openchat

SkalskiP / courses

SuperDuperDB / superduperdb

lucidrains / deep-daze

cmhungsteve / Awesome-Transformer-Attention

bentrevett / pytorch-sentiment-analysis

lucidrains / x-transformers

trigaten / Learn_Prompting

marqo-ai / marqo

ThilinaRajapakse / simpletransformers

IDEA-CCNL / Fengshenbang-LM

huggingface / alignment-handbook