transformers

There are 88 repositories under transformers topic.

annotated_deep_learning_paper_implementations
labmlai / annotated_deep_learning_paper_implementations
🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
attention deep-learning deep-learning-tutorial gan literate-programming machine-learning neural-networks optimizers pytorch reinforcement-learning transformer transformers
Language:Jupyter Notebook 48888
generative-ai-for-beginners
microsoft / generative-ai-for-beginners
18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/
ai chatgpt dall-e generativeai gpt azure generative-ai llms openai prompt-engineering language-model semantic-search transformers
Language:Jupyter Notebook 43760
LLaMA-Factory
hiyouga / LLaMA-Factory
Unify Efficient Fine-Tuning of 100+ LLMs
fine-tuning language-model llama llm peft transformers rlhf qlora quantization chatglm qwen instruction-tuning mistral gpt lora large-language-models agent ai moe llama3
Language:Python 21985
lucidrains / vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
artificial-intelligence attention-mechanism computer-vision image-classification transformers
Language:Python 18202
amusi / CVPR2024-Papers-with-Code
CVPR 2024 论文和开源项目合集
cvpr cvpr2020 computer-vision deep-learning machine-learning object-detection image-segmentation paper image-processing visual-tracking python cvpr2021 semantic-segmentation cvpr2022 transformer transformers cvpr2023 cvpr2024
16328
huggingface / peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
adapter diffusion llm lora parameter-efficient-learning python pytorch transformers
Language:Python 14044
haystack
deepset-ai / haystack
:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
nlp question-answering bert language-model pytorch semantic-search squad information-retrieval summarization transformers machine-learning ai python chatgpt gpt-3 large-language-models generative-ai
Language:Python 13848
BlinkDL / RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
attention-mechanism deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn transformer transformers rwkv chatgpt
Language:Python 11737
PaddleNLP
PaddlePaddle / PaddleNLP
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
nlp embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine semantic-analysis sentiment-analysis neural-search uie document-intelligence compression llm distributed-training llama
Language:Python 11498
stas00 / ml-engineering
Machine Learning Engineering Open Book
ai large-language-models llm machine-learning machine-learning-engineering mlops pytorch scalability slurm transformers
Language:Python 9904
NVIDIA / Megatron-LM
Ongoing research training transformer models at scale
large-language-models model-para transformers
Language:Python 8779
tokenizers
huggingface / tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
nlp natural-language-processing natural-language-understanding language-model transformers bert gpt
Language:Rust 8505
EleutherAI / gpt-neo
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
language-model transformers gpt gpt-2 gpt-3
Language:Python 8150
speechbrain / speechbrain
A PyTorch-based Speech Toolkit
speech-recognition speech-toolkit speaker-recognition speech-to-text speech-enhancement speech-separation audio audio-processing speech-processing speechrecognition asr voice-recognition spoken-language-understanding speaker-diarization speaker-verification pytorch huggingface transformers language-model deep-learning
Language:Python 7955
NielsRogge / Transformers-Tutorials
This repository contains demos I made with the Transformers library by HuggingFace.
transformers pytorch bert vision-transformer layoutlm gpt-2
Language:Jupyter Notebook 7923
xenova / transformers.js
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
browser javascript transformers webml
Language:JavaScript 7757
lucidrains / PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
artificial-intelligence attention-mechanisms deep-learning human-feedback reinforcement-learning transformers
Language:Python 7601
txtai
neuml / txtai
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
python search machine-learning nlp semantic-search neural-search vector-search txtai llm vector-database language-model transformers sentence-embeddings large-language-models information-retrieval search-engine vector-search-engine embeddings retrieval-augmented-generation rag
Language:Python 7090
EleutherAI / gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
deepspeed-library gpt-3 transformers language-model
Language:Python 6619
bertviz
jessevig / bertviz
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
bert gpt2 machine-learning natural-language-processing neural-network nlp pytorch roberta transformer transformers visualization
Language:Python 6420
intel-analytics / ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, etc.
pytorch llm transformers gpu
Language:Python 6053
openvinotoolkit / openvino
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
inference deep-learning openvino ai computer-vision diffusion-models generative-ai llm-inference natural-language-processing nlp performance-boost speech-recognition stable-diffusion deploy-ai optimize-ai transformers yolo recommendation-system good-first-issue
Language:C++ 6017
BERTopic
MaartenGr / BERTopic
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
bert ldavis machine-learning nlp sentence-embeddings topic topic-modeling topic-modelling topic-models transformers
Language:Python 5615
lucidrains / DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
artificial-intelligence deep-learning attention-mechanism text-to-image transformers multi-modal
Language:Python 5493
imoneoi / openchat
OpenChat: Advancing Open-source Language Models with Imperfect Data
large-language-models open-source transformers
Language:Python 4988
SkalskiP / courses
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
computer-vision deep-learning deep-neural-networks generative-model machine-learning mlops multimodal natural-language-processing nlp stable-diffusion transformers tutorial
Language:Python 4575
superduperdb
SuperDuperDB / superduperdb
🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
ai mlops torch transformers mongodb python pytorch ml database data inference distributed-ml llm-inference pretrained-models chatbot semantic-search llm-serving llmops vector-search rag
Language:Python 4399
lucidrains / deep-daze
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
artificial-intelligence deep-learning implicit-neural-representation multi-modality siren text-to-image transformers
Language:Python 4380
cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
transformer attention-mechanism vision-transformer deep-learning awesome-list transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer computer-vision papers attention-mechanisms self-attention vit detr transformers
4279
bentrevett / pytorch-sentiment-analysis
Tutorials on getting started with PyTorch and TorchText for sentiment analysis.
bert cnn cnn-text-classification fasttext lstm lstm-sentiment-analysis natural-language-processing nlp pytorch pytorch-nlp pytorch-tutorial pytorch-tutorials recurrent-neural-networks rnn sentiment-analysis sentiment-classification torchtext transformers tutorial word-embeddings
Language:Jupyter Notebook 4251
lucidrains / x-transformers
A simple but complete full-attention transformer with a set of promising experimental features from various papers
artificial-intelligence attention-mechanism deep-learning transformers
Language:Python 4193
marqo
marqo-ai / marqo
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
chatgpt clip deep-learning gpt hacktoberfest hnsw information-retrieval knn large-language-models machine-learning machinelearning multi-modal natural-language-processing search-engine semantic-search tensor-search transformers vector-search vision-language visual-search
Language:Python 4178
trigaten / Learn_Prompting
Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community
gpt-3 prompting prompt-engineering gpt3 llm chatgpt gpt-4 gpt-4-api large-language-models nlp transformers chatgpt-api deep-learning machine-learning prompt-tuning prompt-toolkit openai-api
Language:MDX 4176
simpletransformers
ThilinaRajapakse / simpletransformers
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
transformers text-classification named-entity-recognition question-answering conversational-ai information-retrival
Language:Python 4000
Fengshenbang-LM
IDEA-CCNL / Fengshenbang-LM
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。
aigc chinese-nlp distributed-training multimodal pretrained-models pytorch transformers
Language:Python 3910
alignment-handbook
huggingface / alignment-handbook
Robust recipes to align language models with human and AI preferences
llm rlhf transformers
Language:Python 3900

transformers

labmlai / annotated_deep_learning_paper_implementations

microsoft / generative-ai-for-beginners

hiyouga / LLaMA-Factory

lucidrains / vit-pytorch

amusi / CVPR2024-Papers-with-Code

huggingface / peft

deepset-ai / haystack

BlinkDL / RWKV-LM

PaddlePaddle / PaddleNLP

stas00 / ml-engineering

NVIDIA / Megatron-LM

huggingface / tokenizers

EleutherAI / gpt-neo

speechbrain / speechbrain

NielsRogge / Transformers-Tutorials

xenova / transformers.js

lucidrains / PaLM-rlhf-pytorch

neuml / txtai

EleutherAI / gpt-neox

jessevig / bertviz

intel-analytics / ipex-llm

openvinotoolkit / openvino

MaartenGr / BERTopic

lucidrains / DALLE-pytorch

imoneoi / openchat

SkalskiP / courses

SuperDuperDB / superduperdb

lucidrains / deep-daze

cmhungsteve / Awesome-Transformer-Attention

bentrevett / pytorch-sentiment-analysis

lucidrains / x-transformers

marqo-ai / marqo

trigaten / Learn_Prompting

ThilinaRajapakse / simpletransformers

IDEA-CCNL / Fengshenbang-LM

huggingface / alignment-handbook