pre-trained-model

There are 13 repositories under pre-trained-model topic.

microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
beit beit-3 bitnet deepnet document-ai foundation-models kosmos kosmos-1 layoutlm layoutxlm llm minilm mllm multimodal nlp pre-trained-model textdiffuser trocr unilm xlm-e
Language:Python 19566
thunlp / OpenPrompt
An Open-Source Framework for Prompt-Learning.
nlp pre-trained-language-models ai nlp-machine-learning natural-language-processing natural-language-understanding deep-learning pre-trained-model nlp-library pytorch transformer prompt prompt-toolkit prompts prompt-based-tuning prompt-learning
Language:Python 4304
brightmart / albert_zh
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
albert bert chinese-corpus pre-trained pre-trained-model pytorch roberta tensorflow xlnet
Language:Python 3919
ChineseGLUE / ChineseGLUE
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
albert bert chinese-corpus datasets glue language-understanding nlp pre-trained-model
Language:Python 1772
SparK
keyu-tian / SparK
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
bert convnet convolutional-neural-networks masked-image-modeling pre-trained-model self-supervised-learning sparse-convolution ssl cnn iclr iclr2023 deep-learning object-detection pytorch instance-segmentation mask-rcnn mae masked-autoencoder pretrain pretraining
Language:Python 1422
ymcui / Chinese-ELECTRA
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
bert chinese chinese-electra electra language-model nlp pre-trained-model pytorch tensorflow
Language:Python 1396
d-li14 / involution
[CVPR 2021] Involution: Inverting the Inherence of Convolution for Visual Recognition, a brand new neural operator
involution operator pytorch image-classification object-detection instance-segmentation semantic-segmentation cvpr2021 pre-trained-model
Language:Python 1307
zjunlp / KnowLM
An Open-sourced Knowledgable Large Language Model Framework.
llama large-language-models pre-trained-language-models language-model instruction-following deep-learning chinese english instructions models reasoning gpt-3 deepspeed instruction-tuning lora pre-training bilingual pre-trained-model knowlm instructie
Language:Python 1204
zjunlp / KnowledgeEditingPapers
Must-read Papers on Knowledge Editing for Large Language Models.
awsome-list easyedit foundation-models knowledge-editing knowlm large-language-models model-editing natural-language-processing paper paper-list pre-trained-language-models pre-trained-model review rome survey
833
NVlabs / FasterViT
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
ade20k backbone deep-learning image-net pre-trained-model self-attention vision-transformer visual-recognition coco object-detection semantic-segmentation foundation-models image-classification
Language:Python 763
MrGiovanni / ModelsGenesis
[MICCAI 2019 Young Scientist Award] [MEDIA 2020 Best Paper Award] Models Genesis
fine-tuning representation-learning transfer-learning self-supervised-learning 3d-model pre-trained-model foundation-models
Language:Jupyter Notebook 729
deepmodeling / Uni-Mol
Official Repository for the Uni-Mol Series Methods
molecular-modeling pre-trained-model pretraining deep-learning
Language:Python 668
salesforce / PCL
PyTorch code for "Prototypical Contrastive Learning of Unsupervised Representations"
contrastive-learning pre-trained-model representation-learning self-supervised-learning unsupervsied-learning
Language:Python 562
mims-harvard / TFC-pretraining
Self-supervised contrastive learning for time series via time-frequency consistency
consistency-models contrastive-learning deep-learning pre-trained-model representation-learning self-supervised-learning time-series
Language:Python 423
NVlabs / GCVit
[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
ade20k backbone coco deep-learning imagenet imagenet-classification object-detection pre-train pre-trained-model self-attention semantic-segmentation vision-transformer visual-recognition
Language:Python 421
edenai / edenai-apis
Eden AI: simplify the use and deployment of AI technologies by providing a unique API that connects to the best possible AI engines
aggregator ai ai-as-a-service api computer-vision document-parsing image-processing machine-translation natural-language-processing nlp ocr optical-character-recognition pre-trained-model python speech-recognition speech-to-text text-to-speech video-recognition
Language:Python 409
ymcui / PERT
PERT: Pre-training BERT with Permuted Language Model
pre-trained-model bert nlp plm tensorflow pytorch transformers
351
nogibjj / rust-mlops-template
A work in progress to build out solutions in Rust for MLOPs
mlops gpu huggingface pytorch rust actix-web aws azure cloud copilot devcontainers microservices polars tensorflow devops gil mlops-workflow onnx pre-trained-model switchtorust
Language:Rust 316
hjbahng / visual_prompting
Exploring Visual Prompts for Adapting Large-Scale Models
pre-trained-model prompt-tuning pytorch transfer-learning visual-prompting
Language:Python 260
iflytek / MiniRBT
MiniRBT (中文小型预训练模型系列)
bert pre-trained-model pytorch roberta tensorflow
Language:Python 244
ZhangYuanhan-AI / NOAH
[TPAMI] Searching prompt modules for parameter-efficient transfer learning.
deep-learning domain-generalization pre-trained-model prompt-tuning pytorch transfer-learning visual-prompting
Language:Python 216
MrGiovanni / SuPreM
[ICLR 2024 Oral] Supervised Pre-Trained 3D Models for Medical Image Analysis (9,262 CT volumes + 25 annotated classes)
dataset medical-imaging pre-trained-model segmentation transfer-learning
Language:Python 212
HKUDS / UrbanGPT
[KDD'2024] "UrbanGPT: Spatio-Temporal Large Language Models"
fundation-models instruction-tuning large-language-models pre-trained-model smart-cities spatio-temporal-prediction urban-computing urban-data-science
Language:Python 202
audio-pretrained-model
balavenkatesh3322 / audio-pretrained-model
A collection of Audio and Speech pre-trained models.
audio audio-processing caffe keras keras-models keras-tensorflow machine-learning mxnet neural-network pre-trained pre-trained-model pre-training python3 pytorch pytorch-models speech-recognition speech-to-text tensorflow tensorflow-models
179
rsommerfeld / trocr
Powerful handwritten text recognition. A simple-to-use, unofficial implementation of the paper "TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models".
computer-vision handwritten-text-recognition ocr pre-trained-model transformer trocr
Language:Python 176
YuanchenBei / Awesome-Pretraining-for-Graph-Neural-Networks
A curated list of papers on pre-training for graph neural networks (Pre-train4GNN).
fine-tuning graph graph-algorithms graph-neural-networks graph-pretraining pre-trained-model pre-training
161
YicongHong / Recurrent-VLN-BERT
Code of the CVPR 2021 Oral paper: A Recurrent Vision-and-Language BERT for Navigation
bert cvpr-oral cvpr2021 pre-trained-model transformer vision-and-language vision-and-language-navigation
Language:Python 149
zjunlp / MolGen
[ICLR 2024] Domain-Agnostic Molecular Generation with Chemical Feedback
generation huggingface iclr2024 language-model molecular-generation molecular-optimization molecule molgen multitask pre-trained-language-models pre-trained-model pre-training pytorch selfies targeted-molecular-generation
Language:Python 124
siat-nlp / GALAXY
Official repository of the AAAI'2022 paper "GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injection"
pre-trained-model dialogue-generation task-oriented-dialogue semi-supervised
Language:Python 106
HKUDS / HiGPT
[KDD'2024] "HiGPT: Heterogenous Graph Language Models"
fundation-models graph-learning graph-model graph-neural-networks instruction-tuning large-language-models pre-trained-model
Language:Python 100
RL4M / MRM-pytorch
An official implementation of Advancing Radiograph Representation Learning with Masked Record Modeling (ICLR'23)
chest-xray-images multi-modal-learning pre-trained-model representation-learning self-supervised-learning
Language:Python 72
CGCL-codes / AdvEncoder
The implementation of our ICCV 2023 paper "Downstream-agnostic Adversarial Examples"
adversarial-examples pre-trained-model
Language:Python 68
RUCAIBox / MVP
This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural Language Generation.
data-to-text dialog multi-task-learning natural-language-generation natural-language-processing nlg nlp plm pre-trained-model question-answering question-generation seq2seq sequence-to-sequence story-generation summarization text-generation
68
HKUDS / GPT-ST
[NeurIPS'2023] "GPT-ST: Generative Pre-Training of Spatio-Temporal Graph Neural Networks"
generative-model graph-neural-networks pre-trained-model spatio-temporal-prediction urban-computing
Language:Python 66
RunxinXu / ChildTuning
Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》
bert fine-tuning nlp pre-trained-model
Language:Python 56
d-li14 / lambda.pytorch
PyTorch implementation of Lambda Network and pretrained Lambda-ResNet
lambda-network attention pytorch iclr2021 imagenet pre-trained-model
Language:Python 54