transformers

There are 40 repositories under transformers topic.

annotated_deep_learning_paper_implementations
labmlai / annotated_deep_learning_paper_implementations
🧑‍🏫 59 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
deep-learning deep-learning-tutorial pytorch gan transformers reinforcement-learning optimizers neural-networks transformer machine-learning attention
Language:Jupyter Notebook 17823
lucidrains / vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
artificial-intelligence attention-mechanism transformers computer-vision image-classification
Language:Python 13325
amusi / CVPR2023-Papers-with-Code
CVPR 2023 论文和开源项目合集
cvpr cvpr2020 computer-vision deep-learning machine-learning object-detection image-segmentation paper image-processing visual-tracking python cvpr2021 semantic-segmentation cvpr2022 transformer transformers cvpr2023
10786
PaddleNLP
PaddlePaddle / PaddleNLP
👑 Easy-to-use and powerful NLP library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis and 🖼 Diffusion AIGC system etc.
nlp seq2seq embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine semantic-analysis sentiment-analysis neural-search uie image-generation document-intelligence stable-diffusion aigc compression
Language:Python 8101
haystack
deepset-ai / haystack
:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-3 and alike). Haystack offers production-ready tools to quickly build ChatGPT-like question answering, semantic search, text generation, and more.
nlp question-answering bert transfer-learning language-model pytorch semantic-search squad elasticsearch information-retrieval summarization transformers natural-language-processing machine-learning ai python chatgpt gpt-3 large-language-models generative-ai
Language:Python 7460
EleutherAI / gpt-neo
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
language-model transformers gpt gpt-2 gpt-3
Language:Python 7388
nebuly-ai / nebullvm
Plug and play modules to optimize the performances of your AI systems 🚀
deep-learning pytorch onnx machine-learning tensorflow tvm openvino tensorrt huggingface compiler computing inference neural-network pypi quantization edge-computing gpu optimization transformers
Language:Python 6933
tokenizers
huggingface / tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
nlp natural-language-processing natural-language-understanding language-model transformers bert gpt
Language:Rust 6600
lucidrains / PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
artificial-intelligence attention-mechanisms deep-learning reinforcement-learning transformers human-feedback
Language:Python 5954
speechbrain / speechbrain
A PyTorch-based Speech Toolkit
speech-recognition speech-toolkit speaker-recognition speech-to-text speech-enhancement speech-separation audio audio-processing speech-processing speechrecognition asr voice-recognition spoken-language-understanding speaker-diarization speaker-verification pytorch huggingface transformers language-model deep-learning
Language:Python 5501
lucidrains / DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
artificial-intelligence deep-learning attention-mechanism text-to-image transformers multi-modal
Language:Python 5076
bertviz
jessevig / bertviz
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
bert gpt2 machine-learning natural-language-processing neural-network nlp pytorch roberta transformer transformers visualization
Language:Python 4976
lucidrains / deep-daze
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
artificial-intelligence deep-learning transformers siren implicit-neural-representation text-to-image multi-modality
Language:Python 4387
EleutherAI / gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
deepspeed-library gpt-3 language-model transformers
Language:Python 4286
BERTopic
MaartenGr / BERTopic
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
bert transformers topic-modeling sentence-embeddings nlp machine-learning topic ldavis topic-modelling topic-models
Language:Python 3956
NielsRogge / Transformers-Tutorials
This repository contains demos I made with the Transformers library by HuggingFace.
transformers pytorch bert vision-transformer layoutlm gpt-2
Language:Jupyter Notebook 3937
bentrevett / pytorch-sentiment-analysis
Tutorials on getting started with PyTorch and TorchText for sentiment analysis.
pytorch sentiment-analysis tutorial rnn lstm fasttext torchtext sentiment-classification cnn cnn-text-classification lstm-sentiment-analysis pytorch-tutorial pytorch-tutorials pytorch-nlp nlp natural-language-processing recurrent-neural-networks word-embeddings transformers bert
Language:Jupyter Notebook 3848
simpletransformers
ThilinaRajapakse / simpletransformers
Transformers for Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
transformers text-classification named-entity-recognition question-answering conversational-ai
Language:Python 3570
spark-nlp
JohnSnowLabs / spark-nlp
State of the Art Natural Language Processing
nlp natural-language-processing spark spark-ml pyspark named-entity-recognition sentiment-analysis lemmatizer spell-checker entity-extraction part-of-speech-tagger bert transformers albert xlnet tensorflow language-detection seq2seq machine-translation text-classification
Language:Scala 3151
CLUEbenchmark / CLUE
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
nlu benchmark chinese corpus dataset bert albert chineseglue glue roberta language-model pretrained-models transformers tensorflow pytorch
Language:Python 3105
jinfagang / yolov7_d2
🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥
yolo yolox detection detextron2 tensorrt yolov6 yolov7 face transformers detr instance-segmentation onnx object-detection
Language:Python 3034
nlp-architect
IntelLabs / nlp-architect
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
deeplearning nlp nlu tensorflow dynet deep-learning pytorch bert transformers quantization
Language:Python 2893
BlinkDL / RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
attention-mechanism deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn transformer transformers rwkv chatgpt
Language:Python 2642
lucidrains / x-transformers
A simple but complete full-attention transformer with a set of promising experimental features from various papers
artificial-intelligence deep-learning attention-mechanism transformers
Language:Python 2600
saharmor / dalle-playground
A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)
dall-e openai gan text-to-image transformers artificial artificial-intelligence machine-learning dalle dalle-mini stable-diffusion
Language:JavaScript 2600
marqo
marqo-ai / marqo
Tensor search for humans.
deep-learning information-retrieval machinelearning vector-search tensor-search clip multi-modal search-engine transformers vision-language machine-learning semantic-search visual-search natural-language-processing hnsw knn hacktoberfest chatgpt gpt large-language-models
Language:Python 2459
cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
attention-mechanism attention-mechanisms awesome-list computer-vision deep-learning detr papers self-attention transformer transformer-architecture transformer-awesome transformer-cv transformer-models transformer-with-cv transformers vision-transformer visual-transformer vit
2395
salesforce / TransmogrifAI
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
ml automl transformations estimators dsl pipelines machine-learning scala salesforce einstein features feature-engineering spark sparkml ai automated-machine-learning transmogrification transmogrify structured-data transformers
Language:Scala 2163
microsoft / presidio
Context aware, pluggable and customizable data protection and de-identification SDK for text and images
data-loss-prevention dlp python pii anonymization privacy data-protection data-anonymization presidio text-anonymization pii-anonymization-service de-identification pii-anonymization data-masking anonymization-service privacy-protection hacktoberfest microsoft transformers
Language:Python 1999
google-research / scenic
Scenic: A Jax Library for Computer Vision Research and Beyond
attention computer-vision deep-learning jax research transformers vision-transformer
Language:Python 1952
lucidrains / reformer-pytorch
Reformer, the efficient Transformer, in Pytorch
artificial-intelligence transformers attention-mechanism machine-learning pytorch
Language:Python 1861
lucidrains / musiclm-pytorch
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
artificial-intelligence attention-mechanisms deep-learning music-synthesis transformers
Language:Python 1828
fast-bert
utterworks / fast-bert
Super easy library for BERT based NLP models
bert fast-bert fastai transformers
Language:Python 1788
argosopentech / argos-translate
Open-source offline translation library written in Python
python machine-translation transformers translation language-models linux nlp open-source
Language:Python 1777
ai-forever / ru-gpts
Russian GPT3 models.
deep-learning gpt3 language-model russian russian-language transformers
Language:Python 1740
christianversloot / machine-learning-articles
🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.
machine-learning deep-learning neural-networks tensorflow pytorch scikit-learn convolutional-neural-networks gan gans transformers huggingface-transformers dbscan clustering bert gpt albert keras keras-tensorflow pytorch-implementation pytorch-tutorial
1731

transformers

labmlai / annotated_deep_learning_paper_implementations

lucidrains / vit-pytorch

amusi / CVPR2023-Papers-with-Code

PaddlePaddle / PaddleNLP

deepset-ai / haystack

EleutherAI / gpt-neo

nebuly-ai / nebullvm

huggingface / tokenizers

lucidrains / PaLM-rlhf-pytorch

speechbrain / speechbrain

lucidrains / DALLE-pytorch

jessevig / bertviz

lucidrains / deep-daze

EleutherAI / gpt-neox

MaartenGr / BERTopic

NielsRogge / Transformers-Tutorials

bentrevett / pytorch-sentiment-analysis

ThilinaRajapakse / simpletransformers

JohnSnowLabs / spark-nlp

CLUEbenchmark / CLUE

jinfagang / yolov7_d2

IntelLabs / nlp-architect

BlinkDL / RWKV-LM

lucidrains / x-transformers

saharmor / dalle-playground

marqo-ai / marqo

cmhungsteve / Awesome-Transformer-Attention

salesforce / TransmogrifAI

microsoft / presidio

google-research / scenic

lucidrains / reformer-pytorch

lucidrains / musiclm-pytorch

utterworks / fast-bert

argosopentech / argos-translate

ai-forever / ru-gpts

christianversloot / machine-learning-articles