transformer

There are 107 repositories under transformer topic.

transformers
huggingface / transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
nlp natural-language-processing pytorch language-model tensorflow bert language-models pytorch-transformers nlp-library transformer model-hub pretrained-models jax flax seq2seq speech-recognition hacktoberfest python machine-learning deep-learning
Language:Python 126025
annotated_deep_learning_paper_implementations
labmlai / annotated_deep_learning_paper_implementations
🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
attention deep-learning deep-learning-tutorial gan literate-programming machine-learning neural-networks optimizers pytorch reinforcement-learning transformer transformers
Language:Jupyter Notebook 48891
whisper.cpp
ggerganov / whisper.cpp
Port of OpenAI's Whisper model in C/C++
openai speech-to-text transformer whisper inference speech-recognition
Language:C 31740
open-mmlab / mmdetection
OpenMMLab Detection Toolbox and Benchmark
object-detection instance-segmentation fast-rcnn faster-rcnn mask-rcnn cascade-rcnn ssd retinanet pytorch panoptic-segmentation rtmdet semisupervised-learning swin-transformer transformer vision-transformer yolo convnext detr glip grounding-dino
Language:Python 27976
vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
amd cuda gpt inference inferentia llama llm llm-serving llmops mlops model-serving pytorch rocm trainium transformer
Language:Python 19462
amusi / CVPR2024-Papers-with-Code
CVPR 2024 论文和开源项目合集
computer-vision cvpr cvpr2020 cvpr2021 cvpr2022 cvpr2023 cvpr2024 deep-learning image-processing image-segmentation machine-learning object-detection paper python semantic-segmentation transformer transformers visual-tracking
16335
ml-tooling / best-of-ml-python
🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
python machine-learning data-science nlp data-visualization tensorflow pytorch scikit-learn keras data-visualizations deep-learning automl ml jax transformer data-analysis chatgpt gpt gpt-3
15661
graykode / nlp-tutorial
Natural Language Processing Tutorial for Deep Learning Researchers
attention bert natural-language-processing nlp paper pytorch tensorflow transformer tutorial
Language:Jupyter Notebook 13750
cfug / dio
A powerful HTTP client for Dart and Flutter, which supports global settings, Interceptors, FormData, aborting and canceling a request, files uploading and downloading, requests timeout, custom adapters, etc.
adapter cancellable dart dio flutter http interceptor middleware network timeout transformer
Language:Dart 12239
BlinkDL / RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
attention-mechanism deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn transformer transformers rwkv chatgpt
Language:Python 11738
LaTeX-OCR
lukas-blecher / LaTeX-OCR
pix2tex: Using a ViT to convert images of equations into LaTeX code.
machine-learning transformer im2latex deep-learning image2text latex dataset pytorch im2markup ocr latex-ocr vit math-ocr vision-transformer image-processing python im2text
Language:Python 10986
PaddlePaddle / PaddleSpeech
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.
transformer conformer speech-translation streaming-asr speech-alignment punctuation-restoration streaming-tts speech-synthesis tts asr kws speech-recognition sound-classification voice-cloning vocoder voice-recognition self-supervised-learning wav2vec2 whisper code-switch
Language:Python 10239
datawhalechina / leedl-tutorial
《李宏毅深度学习教程》（李宏毅老师推荐👍），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases
machine-learning deep-learning leedl-tutorial cnn reinforcement-learning transformer rnn gan pruning self-attention chatgpt tutorial network-compression diffusion transfer-learning bert
Language:Jupyter Notebook 9886
SYSTRAN / faster-whisper
Faster Whisper transcription with CTranslate2
deep-learning inference quantization speech-recognition speech-to-text transformer whisper openai
Language:Python 9147
bigscience-workshop / petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
bloom deep-learning distributed-systems language-models large-language-models machine-learning neural-networks pytorch volunteer-computing pipeline-parallelism tensor-parallelism guanaco llama chatbot gpt transformer nlp pretrained-models llama2 falcon
Language:Python 8730
PaddlePaddle / PaddleSeg
Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.
autonomous-driving human-segmentation image-matting image-segmentation interactive-segmentation lane-detection medical-image-segmentation panoptic-segmentation semantic-segmentation transformer video-segmentation
Language:Python 8292
OptimalScale / LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
chatgpt deep-learning instruction-following language-model pretrained-models pytorch transformer
Language:Python 8043
huggingface / text-generation-inference
Large Language Model Text Generation Inference
bloom nlp pytorch inference gpt deep-learning transformer falcon starcoder
Language:Python 8011
google / trax
Trax — Deep Learning with Clear Code and Speed
deep-learning deep-reinforcement-learning jax machine-learning numpy reinforcement-learning transformer
Language:Python 7962
openai / jukebox
Code for the paper "Jukebox: A Generative Model for Music"
audio generative-model music paper pytorch transformer vq-vae
Language:Python 7600
open-mmlab / mmsegmentation
OpenMMLab Semantic Segmentation Toolbox and Benchmark.
semantic-segmentation pytorch pspnet deeplabv3 transformer swin-transformer realtime-segmentation vessel-segmentation retinal-vessel-segmentation image-segmentation medical-image-segmentation
Language:Python 7474
Morizeyao / GPT2-Chinese
Chinese version of GPT2 training code, using BERT tokenizer.
chinese gpt-2 nlp text-generation transformer
Language:Python 7363
bertviz
jessevig / bertviz
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
bert gpt2 machine-learning natural-language-processing neural-network nlp pytorch roberta transformer transformers visualization
Language:Python 6421
codertimo / BERT-pytorch
Google AI 2018 BERT pytorch implementation
bert transformer pytorch nlp language-model
Language:Python 6021
NVIDIA / FasterTransformer
Transformer related optimization, including BERT, GPT
pytorch transformer gpt bert
Language:C++ 5500
EleutherAI / lm-evaluation-harness
A framework for few-shot evaluation of language models.
evaluation-framework language-model transformer
Language:Python 5213
bentrevett / pytorch-seq2seq
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
attention cnn-seq2seq encoder-decoder encoder-decoder-model gru lstm neural-machine-translation pytorch pytorch-implementation pytorch-implmention pytorch-nlp pytorch-seq2seq pytorch-tutorial pytorch-tutorials rnn seq2seq sequence-to-sequence torchtext transformer tutorial
Language:Jupyter Notebook 5176
zhouhaoyi / Informer2020
The GitHub repository for the paper "Informer" accepted by AAAI 2021.
deep-learning self-attention time-series pytorch forecasting transformer
Language:Python 4960
timeseriesAI / tsai
Time series Timeseries Deep Learning Machine Learning Pytorch fastai | State-of-the-art Deep Learning library for Time Series and Sequences in Pytorch / fastai
time-series-classification deep-learning fastai pytorch timeseries time-series sequential time-series-analysis transformer cnn rnn state-of-the-art self-supervised classification regression forecasting inceptiontime rocket machine-learning python
Language:Jupyter Notebook 4743
zyddnys / manga-image-translator
Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/
anime auto-translation chinese-translation deep-learning image-processing inpainting japanese-translations machine-translation manga neural-network ocr pytorch-implementation text-detection text-detection-recognition transformer
Language:Python 4332
cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
attention-mechanism attention-mechanisms awesome-list computer-vision deep-learning detr papers self-attention transformer transformer-architecture transformer-awesome transformer-cv transformer-models transformer-with-cv transformers vision-transformer visual-transformer vit
4279
Kyubyong / transformer
A TensorFlow Implementation of the Transformer: Attention Is All You Need
attention-mechanism translation attention-is-all-you-need implementation transformer
Language:Python 4173
thunlp / OpenPrompt
An Open-Source Framework for Prompt-Learning.
nlp pre-trained-language-models ai nlp-machine-learning natural-language-processing natural-language-understanding deep-learning pre-trained-model nlp-library pytorch transformer prompt prompt-toolkit prompts prompt-based-tuning prompt-learning
Language:Python 4170
JingyunLiang / SwinIR
SwinIR: Image Restoration Using Swin Transformer (official repository)
image-super-resolution image-denoising compression-artifact-reduction image-deblocking transformer real-world-image-super-resolution lightweight-image-super-resolution image-restoration low-level-vision vision-transformer image-sr restoration super-resolution denoising deblocking decompression
Language:Python 4103
AutoGPTQ / AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
deep-learning inference large-language-models llms nlp pytorch quantization transformer transformers
Language:Python 3852
huawei-noah / Efficient-AI-Backbones
Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.
convolutional-neural-networks efficient-inference imagenet model-compression tensorflow pytorch ghostnet transformer pretrained-models vision-transformer
Language:Python 3842

transformer

huggingface / transformers

labmlai / annotated_deep_learning_paper_implementations

ggerganov / whisper.cpp

open-mmlab / mmdetection

vllm-project / vllm

amusi / CVPR2024-Papers-with-Code

ml-tooling / best-of-ml-python

graykode / nlp-tutorial

cfug / dio

BlinkDL / RWKV-LM

lukas-blecher / LaTeX-OCR

PaddlePaddle / PaddleSpeech

datawhalechina / leedl-tutorial

SYSTRAN / faster-whisper

bigscience-workshop / petals

PaddlePaddle / PaddleSeg

OptimalScale / LMFlow

huggingface / text-generation-inference

google / trax

openai / jukebox

open-mmlab / mmsegmentation

Morizeyao / GPT2-Chinese

jessevig / bertviz

codertimo / BERT-pytorch

NVIDIA / FasterTransformer

EleutherAI / lm-evaluation-harness

bentrevett / pytorch-seq2seq

zhouhaoyi / Informer2020

timeseriesAI / tsai

zyddnys / manga-image-translator

cmhungsteve / Awesome-Transformer-Attention

Kyubyong / transformer

thunlp / OpenPrompt

JingyunLiang / SwinIR

AutoGPTQ / AutoGPTQ

huawei-noah / Efficient-AI-Backbones