pre-trained-model

There are 12 repositories under pre-trained-model topic.

microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
nlp pre-trained-model unilm minilm layoutlm layoutxlm beit document-ai trocr beit-3 foundation-models xlm-e deepnet llm multimodal mllm kosmos kosmos-1 textdiffuser bitnet
Language:Python 18573
thunlp / OpenPrompt
An Open-Source Framework for Prompt-Learning.
nlp pre-trained-language-models ai nlp-machine-learning natural-language-processing natural-language-understanding deep-learning pre-trained-model nlp-library pytorch transformer prompt prompt-toolkit prompts prompt-based-tuning prompt-learning
Language:Python 4177
brightmart / albert_zh
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
albert bert chinese-corpus pre-trained pre-trained-model pytorch roberta tensorflow xlnet
Language:Python 3905
ChineseGLUE / ChineseGLUE
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
glue language-understanding bert pre-trained-model chinese-corpus nlp albert datasets
Language:Python 1767
SparK
keyu-tian / SparK
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
bert convnet convolutional-neural-networks masked-image-modeling pre-trained-model self-supervised-learning sparse-convolution ssl cnn iclr iclr2023 deep-learning object-detection pytorch instance-segmentation mask-rcnn mae masked-autoencoder pretrain pretraining
Language:Python 1389
ymcui / Chinese-ELECTRA
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
bert chinese chinese-electra electra language-model nlp pre-trained-model pytorch tensorflow
Language:Python 1380
d-li14 / involution
[CVPR 2021] Involution: Inverting the Inherence of Convolution for Visual Recognition, a brand new neural operator
cvpr2021 image-classification instance-segmentation involution object-detection operator pre-trained-model pytorch semantic-segmentation
Language:Python 1305
zjunlp / KnowLM
An Open-sourced Knowledgable Large Language Model Framework.
llama large-language-models pre-trained-language-models language-model instruction-following deep-learning chinese english instructions models reasoning gpt-3 deepspeed instruction-tuning lora pre-training bilingual pre-trained-model knowlm instructie
Language:Python 1034
MrGiovanni / ModelsGenesis
[MICCAI 2019] [MEDIA 2020] Models Genesis
fine-tuning representation-learning transfer-learning self-supervised-learning 3d-model pre-trained-model foundation-models
Language:Jupyter Notebook 722
NVlabs / FasterViT
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
ade20k backbone deep-learning image-net pre-trained-model self-attention vision-transformer visual-recognition coco object-detection semantic-segmentation foundation-models image-classification
Language:Python 693
zjunlp / KnowledgeEditingPapers
Must-read Papers on Knowledge Editing for Large Language Models.
paper-list pre-trained-language-models pre-trained-model knowledge-editing model-editing large-language-models awsome-list foundation-models natural-language-processing review survey rome easyedit knowlm paper
614
dptech-corp / Uni-Mol
Official Repository for the Uni-Mol Series Methods
molecular-modeling pre-trained-model pretraining deep-learning
Language:Python 554
salesforce / PCL
PyTorch code for "Prototypical Contrastive Learning of Unsupervised Representations"
representation-learning self-supervised-learning unsupervsied-learning contrastive-learning pre-trained-model
Language:Python 542
NVlabs / GCVit
[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
vision-transformer ade20k coco deep-learning imagenet imagenet-classification object-detection pre-train pre-trained-model self-attention semantic-segmentation backbone visual-recognition
Language:Python 415
mims-harvard / TFC-pretraining
Self-supervised contrastive learning for time series via time-frequency consistency
consistency-models contrastive-learning deep-learning pre-trained-model representation-learning self-supervised-learning time-series
Language:Python 384
edenai / edenai-apis
Eden AI: simplify the use and deployment of AI technologies by providing a unique API that connects to the best possible AI engines
aggregator ai ai-as-a-service api computer-vision document-parsing image-processing machine-translation natural-language-processing nlp ocr optical-character-recognition pre-trained-model python speech-recognition speech-to-text text-to-speech video-recognition
Language:Python 369
ymcui / PERT
PERT: Pre-training BERT with Permuted Language Model
pre-trained-model bert nlp plm tensorflow pytorch transformers
345
nogibjj / rust-mlops-template
A work in progress to build out solutions in Rust for MLOPs
actix-web aws azure cloud copilot devcontainers devops gil gpu huggingface microservices mlops mlops-workflow onnx polars pre-trained-model pytorch rust switchtorust tensorflow
Language:Rust 274
hjbahng / visual_prompting
Exploring Visual Prompts for Adapting Large-Scale Models
pre-trained-model prompt-tuning pytorch visual-prompting transfer-learning
Language:Python 244
iflytek / MiniRBT
MiniRBT (中文小型预训练模型系列)
bert pre-trained-model pytorch roberta tensorflow
Language:Python 216
ZhangYuanhan-AI / NOAH
Searching prompt modules for parameter-efficient transfer learning.
prompt-tuning transfer-learning domain-generalization visual-prompting pre-trained-model pytorch deep-learning
Language:Python 205
audio-pretrained-model
balavenkatesh3322 / audio-pretrained-model
A collection of Audio and Speech pre-trained models.
pre-trained-model pre-trained pre-training tensorflow keras keras-tensorflow neural-network mxnet machine-learning python3 caffe keras-models tensorflow-models pytorch pytorch-models audio speech-recognition speech-to-text audio-processing
170
rsommerfeld / trocr
Powerful handwritten text recognition. A simple-to-use, unofficial implementation of the paper "TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models".
trocr ocr handwritten-text-recognition transformer computer-vision pre-trained-model
Language:Python 156
YicongHong / Recurrent-VLN-BERT
Code of the CVPR 2021 Oral paper: A Recurrent Vision-and-Language BERT for Navigation
vision-and-language-navigation cvpr2021 cvpr-oral transformer bert pre-trained-model vision-and-language
Language:Python 144
MrGiovanni / SuPreM
[ICLR 2024] Supervised Pre-Trained 3D Models for Medical Image Analysis
dataset medical-imaging pre-trained-model segmentation transfer-learning
Language:Python 141
YuanchenBei / Awesome-Pretraining-for-Graph-Neural-Networks
A curated list of papers on pre-training for graph neural networks (Pre-train4GNN).
fine-tuning graph-neural-networks pre-trained-model pre-training graph-pretraining graph graph-algorithms
134
HKUDS / UrbanGPT
"UrbanGPT: Spatio-Temporal Large Language Models"
fundation-models instruction-tuning large-language-models pre-trained-model smart-cities spatio-temporal-prediction urban-computing urban-data-science
Language:Python 111
zjunlp / MolGen
[ICLR 2024] Domain-Agnostic Molecular Generation with Chemical Feedback
language-model molecular-generation pre-trained-language-models pre-trained-model molgen molecule molecular-optimization selfies targeted-molecular-generation pre-training generation multitask huggingface pytorch iclr2024
Language:Python 106
siat-nlp / GALAXY
Official repository of the AAAI'2022 paper "GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injection"
pre-trained-model dialogue-generation task-oriented-dialogue semi-supervised
Language:Python 105
RL4M / MRM-pytorch
An official implementation of Advancing Radiograph Representation Learning with Masked Record Modeling (ICLR'23)
chest-xray-images multi-modal-learning pre-trained-model representation-learning self-supervised-learning
Language:Python 70
HKUDS / HiGPT
"HiGPT: Heterogenous Graph Language Models"
fundation-models graph-learning graph-model graph-neural-networks instruction-tuning large-language-models pre-trained-model
Language:Python 69
CGCL-codes / AdvEncoder
The implementation of our ICCV 2023 paper "Downstream-agnostic Adversarial Examples"
adversarial-examples pre-trained-model
Language:Python 67
RUCAIBox / MVP
This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural Language Generation.
nlp dialog natural-language-processing question-answering seq2seq summarization text-generation sequence-to-sequence data-to-text natural-language-generation nlg question-generation story-generation multi-task-learning plm pre-trained-model
66
RunxinXu / ChildTuning
Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》
nlp fine-tuning pre-trained-model bert
Language:Python 56
d-li14 / lambda.pytorch
PyTorch implementation of Lambda Network and pretrained Lambda-ResNet
attention iclr2021 imagenet lambda-network pre-trained-model pytorch
Language:Python 54
zjunlp / NLP4SciencePapers
Must-read papers on NLP for science.
ai4science nlp science nlp4science ai awsome-list language-model moleculer paper-list pre-trained-model protein survey transformer
50