transformer

There are 122 repositories under transformer topic.

transformers
huggingface / transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
nlp natural-language-processing pytorch language-model tensorflow bert language-models pytorch-transformers nlp-library transformer model-hub pretrained-models jax flax seq2seq speech-recognition hacktoberfest python machine-learning deep-learning
Language:Python 135833
annotated_deep_learning_paper_implementations
labmlai / annotated_deep_learning_paper_implementations
🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
attention deep-learning deep-learning-tutorial gan literate-programming lora machine-learning neural-networks optimizers pytorch reinforcement-learning transformer transformers
Language:Python 56814
whisper.cpp
ggerganov / whisper.cpp
Port of OpenAI's Whisper model in C/C++
inference openai speech-recognition speech-to-text transformer whisper
Language:C++ 36010
vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
amd cuda gpt hpu inference inferentia llama llm llm-serving llmops mlops model-serving pytorch rocm tpu trainium transformer xpu
Language:Python 31216
open-mmlab / mmdetection
OpenMMLab Detection Toolbox and Benchmark
cascade-rcnn convnext detr fast-rcnn faster-rcnn glip grounding-dino instance-segmentation mask-rcnn object-detection panoptic-segmentation pytorch retinanet rtmdet semisupervised-learning ssd swin-transformer transformer vision-transformer yolo
Language:Python 29731
amusi / CVPR2024-Papers-with-Code
CVPR 2024 论文和开源项目合集
computer-vision cvpr cvpr2020 cvpr2021 cvpr2022 cvpr2023 cvpr2024 deep-learning image-processing image-segmentation machine-learning object-detection paper python semantic-segmentation transformer transformers visual-tracking
18434
ml-tooling / best-of-ml-python
🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
python machine-learning data-science nlp data-visualization tensorflow pytorch scikit-learn keras data-visualizations deep-learning automl ml jax transformer data-analysis chatgpt gpt gpt-3
18225
fishaudio / fish-speech
Brand new TTS solution
llama transformer tts valle vits vqgan vqvae
Language:Python 14824
graykode / nlp-tutorial
Natural Language Processing Tutorial for Deep Learning Researchers
attention bert natural-language-processing nlp paper pytorch tensorflow transformer tutorial
Language:Jupyter Notebook 14318
datawhalechina / leedl-tutorial
《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases
bert chatgpt cnn deep-learning diffusion gan leedl-tutorial machine-learning network-compression pruning reinforcement-learning rnn self-attention transfer-learning transformer tutorial
Language:Jupyter Notebook 13952
LaTeX-OCR
lukas-blecher / LaTeX-OCR
pix2tex: Using a ViT to convert images of equations into LaTeX code.
dataset deep-learning im2latex im2markup im2text image-processing image2text latex latex-ocr machine-learning math-ocr ocr python pytorch transformer vision-transformer vit
Language:Python 12937
SYSTRAN / faster-whisper
Faster Whisper transcription with CTranslate2
deep-learning inference openai quantization speech-recognition speech-to-text transformer whisper
Language:Python 12775
BlinkDL / RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
attention-mechanism chatgpt deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn rwkv transformer transformers
Language:Python 12731
cfug / dio
A powerful HTTP client for Dart and Flutter, which supports global settings, Interceptors, FormData, aborting and canceling a request, files uploading and downloading, requests timeout, custom adapters, etc.
flutter dart adapter http network timeout transformer cancellable dio interceptor middleware
Language:Dart 12522
PaddlePaddle / PaddleSpeech
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.
asr code-switch conformer kws punctuation-restoration self-supervised-learning sound-classification speech-alignment speech-recognition speech-synthesis speech-translation streaming-asr streaming-tts transformer tts vocoder voice-cloning voice-recognition wav2vec2 whisper
Language:Python 11223
bigscience-workshop / petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
bloom chatbot deep-learning distributed-systems falcon gpt guanaco language-models large-language-models llama machine-learning mixtral neural-networks nlp pipeline-parallelism pretrained-models pytorch tensor-parallelism transformer volunteer-computing
Language:Python 9270
huggingface / text-generation-inference
Large Language Model Text Generation Inference
bloom deep-learning falcon gpt inference nlp pytorch starcoder transformer
Language:Python 9177
PaddlePaddle / PaddleSeg
Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.
autonomous-driving human-segmentation image-matting image-segmentation interactive-segmentation lane-detection medical-image-segmentation panoptic-segmentation semantic-segmentation transformer video-segmentation
Language:Python 8733
open-mmlab / mmsegmentation
OpenMMLab Semantic Segmentation Toolbox and Benchmark.
semantic-segmentation pytorch pspnet deeplabv3 transformer swin-transformer realtime-segmentation vessel-segmentation retinal-vessel-segmentation image-segmentation medical-image-segmentation
Language:Python 8360
OptimalScale / LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
chatgpt deep-learning instruction-following language-model pretrained-models pytorch transformer
Language:Python 8294
google / trax
Trax — Deep Learning with Clear Code and Speed
jax numpy deep-learning deep-reinforcement-learning machine-learning transformer reinforcement-learning
Language:Python 8111
openai / jukebox
Code for the paper "Jukebox: A Generative Model for Music"
audio generative-model music paper pytorch transformer vq-vae
Language:Python 7835
Morizeyao / GPT2-Chinese
Chinese version of GPT2 training code, using BERT tokenizer.
chinese gpt-2 nlp text-generation transformer
Language:Python 7478
EleutherAI / lm-evaluation-harness
A framework for few-shot evaluation of language models.
evaluation-framework language-model transformer
Language:Python 7115
bertviz
jessevig / bertviz
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
bert gpt2 machine-learning natural-language-processing neural-network nlp pytorch roberta transformer transformers visualization
Language:Python 6985
sgl-project / sglang
SGLang is a fast serving framework for large language models and vision language models.
cuda inference llama llama2 llama3 llama3-1 llava llm llm-serving moe pytorch transformer vlm
Language:Python 6329
codertimo / BERT-pytorch
Google AI 2018 BERT pytorch implementation
bert language-model nlp pytorch transformer
Language:Python 6235
NVIDIA / FasterTransformer
Transformer related optimization, including BERT, GPT
bert gpt pytorch transformer
Language:C++ 5919
zhouhaoyi / Informer2020
The GitHub repository for the paper "Informer" accepted by AAAI 2021.
deep-learning forecasting pytorch self-attention time-series transformer
Language:Python 5489
zyddnys / manga-image-translator
Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/
anime auto-translation chinese-translation deep-learning image-processing inpainting japanese-translations machine-translation manga neural-network ocr pytorch-implementation text-detection text-detection-recognition transformer
Language:Python 5436
bentrevett / pytorch-seq2seq
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
pytorch seq2seq sequence-to-sequence tutorial rnn gru lstm torchtext pytorch-tutorial pytorch-implmention encoder-decoder encoder-decoder-model neural-machine-translation pytorch-seq2seq attention transformer cnn-seq2seq pytorch-implementation pytorch-tutorials pytorch-nlp
Language:Jupyter Notebook 5403
timeseriesAI / tsai
Time series Timeseries Deep Learning Machine Learning Python Pytorch fastai | State-of-the-art Deep Learning library for Time Series and Sequences in Pytorch / fastai
classification cnn deep-learning fastai forecasting inceptiontime machine-learning python pytorch regression rnn rocket self-supervised sequential state-of-the-art time-series time-series-analysis time-series-classification timeseries transformer
Language:Jupyter Notebook 5306
InternLM / MindSearch
🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
ai-search-engine gpt llm llms multi-agent-systems perplexity-ai search searchgpt transformer web-search
Language:JavaScript 5259
cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
attention-mechanism attention-mechanisms awesome-list computer-vision deep-learning detr papers self-attention transformer transformer-architecture transformer-awesome transformer-cv transformer-models transformer-with-cv transformers vision-transformer visual-transformer vit
4668
AutoGPTQ / AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
deep-learning inference large-language-models llms nlp pytorch quantization transformer transformers
Language:Python 4533
JingyunLiang / SwinIR
SwinIR: Image Restoration Using Swin Transformer (official repository)
compression-artifact-reduction deblocking decompression denoising image-deblocking image-denoising image-restoration image-sr image-super-resolution lightweight-image-super-resolution low-level-vision real-world-image-super-resolution restoration super-resolution transformer vision-transformer
Language:Python 4490