pre-trained-model

There are 12 repositories under pre-trained-model topic.

microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
beit beit-3 bitnet deepnet document-ai foundation-models kosmos kosmos-1 layoutlm layoutxlm llm minilm mllm multimodal nlp pre-trained-model textdiffuser trocr unilm xlm-e
Language:Python 18378
thunlp / OpenPrompt
An Open-Source Framework for Prompt-Learning.
ai deep-learning natural-language-processing natural-language-understanding nlp nlp-library nlp-machine-learning pre-trained-language-models pre-trained-model prompt prompt-based-tuning prompt-learning prompt-toolkit prompts pytorch transformer
Language:Python 4158
brightmart / albert_zh
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
albert bert roberta xlnet tensorflow pytorch pre-trained-model chinese-corpus pre-trained
Language:Python 3905
ChineseGLUE / ChineseGLUE
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
glue language-understanding bert pre-trained-model chinese-corpus nlp albert datasets
Language:Python 1767
SparK
keyu-tian / SparK
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
bert cnn convnet convolutional-neural-networks deep-learning iclr iclr2023 instance-segmentation mae mask-rcnn masked-autoencoder masked-image-modeling object-detection pre-trained-model pretrain pretraining pytorch self-supervised-learning sparse-convolution ssl
Language:Python 1388
ymcui / Chinese-ELECTRA
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
bert chinese chinese-electra electra language-model nlp pre-trained-model pytorch tensorflow
Language:Python 1376
d-li14 / involution
[CVPR 2021] Involution: Inverting the Inherence of Convolution for Visual Recognition, a brand new neural operator
involution operator pytorch image-classification object-detection instance-segmentation semantic-segmentation cvpr2021 pre-trained-model
Language:Python 1304
zjunlp / KnowLM
An Open-sourced Knowledgable Large Language Model Framework.
llama large-language-models pre-trained-language-models language-model instruction-following deep-learning chinese english instructions models reasoning gpt-3 deepspeed instruction-tuning lora pre-training bilingual pre-trained-model knowlm instructie
Language:Python 1018
MrGiovanni / ModelsGenesis
[MICCAI 2019] [MEDIA 2020] Models Genesis
fine-tuning representation-learning transfer-learning self-supervised-learning 3d-model pre-trained-model foundation-models
Language:Jupyter Notebook 722
NVlabs / FasterViT
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
ade20k backbone coco deep-learning foundation-models image-classification image-net object-detection pre-trained-model self-attention semantic-segmentation vision-transformer visual-recognition
Language:Python 675
zjunlp / KnowledgeEditingPapers
Must-read Papers on Knowledge Editing for Large Language Models.
paper-list pre-trained-language-models pre-trained-model knowledge-editing model-editing large-language-models awsome-list foundation-models natural-language-processing review survey rome easyedit knowlm paper
598
dptech-corp / Uni-Mol
Official Repository for the Uni-Mol Series Methods
deep-learning molecular-modeling pre-trained-model pretraining
Language:Python 541
salesforce / PCL
PyTorch code for "Prototypical Contrastive Learning of Unsupervised Representations"
representation-learning self-supervised-learning unsupervsied-learning contrastive-learning pre-trained-model
Language:Python 540
NVlabs / GCVit
[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
vision-transformer ade20k coco deep-learning imagenet imagenet-classification object-detection pre-train pre-trained-model self-attention semantic-segmentation backbone visual-recognition
Language:Python 414
mims-harvard / TFC-pretraining
Self-supervised contrastive learning for time series via time-frequency consistency
consistency-models contrastive-learning deep-learning pre-trained-model representation-learning self-supervised-learning time-series
Language:Python 375
edenai / edenai-apis
Eden AI: simplify the use and deployment of AI technologies by providing a unique API that connects to the best possible AI engines
aggregator ai ai-as-a-service api computer-vision document-parsing image-processing machine-translation natural-language-processing nlp ocr optical-character-recognition pre-trained-model python speech-recognition speech-to-text text-to-speech video-recognition
Language:Python 361
ymcui / PERT
PERT: Pre-training BERT with Permuted Language Model
pre-trained-model bert nlp plm tensorflow pytorch transformers
345
nogibjj / rust-mlops-template
A work in progress to build out solutions in Rust for MLOPs
mlops gpu huggingface pytorch rust actix-web aws azure cloud copilot devcontainers microservices polars tensorflow devops gil mlops-workflow onnx pre-trained-model switchtorust
Language:Rust 273
hjbahng / visual_prompting
Exploring Visual Prompts for Adapting Large-Scale Models
pre-trained-model prompt-tuning pytorch transfer-learning visual-prompting
Language:Python 243
iflytek / MiniRBT
MiniRBT (中文小型预训练模型系列)
bert pre-trained-model pytorch roberta tensorflow
Language:Python 215
ZhangYuanhan-AI / NOAH
Searching prompt modules for parameter-efficient transfer learning.
prompt-tuning transfer-learning domain-generalization visual-prompting pre-trained-model pytorch deep-learning
Language:Python 203
audio-pretrained-model
balavenkatesh3322 / audio-pretrained-model
A collection of Audio and Speech pre-trained models.
pre-trained-model pre-trained pre-training tensorflow keras keras-tensorflow neural-network mxnet machine-learning python3 caffe keras-models tensorflow-models pytorch pytorch-models audio speech-recognition speech-to-text audio-processing
170
rsommerfeld / trocr
Powerful handwritten text recognition. A simple-to-use, unofficial implementation of the paper "TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models".
computer-vision handwritten-text-recognition ocr pre-trained-model transformer trocr
Language:Python 154
YicongHong / Recurrent-VLN-BERT
Code of the CVPR 2021 Oral paper: A Recurrent Vision-and-Language BERT for Navigation
bert cvpr-oral cvpr2021 pre-trained-model transformer vision-and-language vision-and-language-navigation
Language:Python 144
YuanchenBei / Awesome-Pretraining-for-Graph-Neural-Networks
A curated list of papers on pre-training for graph neural networks (Pre-train4GNN).
fine-tuning graph graph-algorithms graph-neural-networks graph-pretraining pre-trained-model pre-training
128
MrGiovanni / SuPreM
[ICLR 2024] Supervised Pre-Trained 3D Models for Medical Image Analysis
dataset medical-imaging pre-trained-model segmentation transfer-learning
Language:Python 111
siat-nlp / GALAXY
Official repository of the AAAI'2022 paper "GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injection"
pre-trained-model dialogue-generation task-oriented-dialogue semi-supervised
Language:Python 105
HKUDS / UrbanGPT
"UrbanGPT: Spatio-Temporal Large Language Models"
fundation-models instruction-tuning large-language-models pre-trained-model smart-cities spatio-temporal-prediction urban-computing urban-data-science
Language:Python 101
zjunlp / MolGen
[ICLR 2024] Domain-Agnostic Molecular Generation with Chemical Feedback
generation huggingface iclr2024 language-model molecular-generation molecular-optimization molecule molgen multitask pre-trained-language-models pre-trained-model pre-training pytorch selfies targeted-molecular-generation
Language:Python 101
RL4M / MRM-pytorch
An official implementation of Advancing Radiograph Representation Learning with Masked Record Modeling (ICLR'23)
chest-xray-images multi-modal-learning pre-trained-model representation-learning self-supervised-learning
Language:Python 70
HKUDS / HiGPT
"HiGPT: Heterogenous Graph Language Models"
fundation-models graph-learning graph-model graph-neural-networks instruction-tuning large-language-models pre-trained-model
Language:Python 68
CGCL-codes / AdvEncoder
The implementation of our ICCV 2023 paper "Downstream-agnostic Adversarial Examples"
adversarial-examples pre-trained-model
Language:Python 66
RUCAIBox / MVP
This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural Language Generation.
nlp dialog natural-language-processing question-answering seq2seq summarization text-generation sequence-to-sequence data-to-text natural-language-generation nlg question-generation story-generation multi-task-learning plm pre-trained-model
66
RunxinXu / ChildTuning
Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》
bert fine-tuning nlp pre-trained-model
Language:Python 56
d-li14 / lambda.pytorch
PyTorch implementation of Lambda Network and pretrained Lambda-ResNet
lambda-network attention pytorch iclr2021 imagenet pre-trained-model
Language:Python 54
zjunlp / NLP4SciencePapers
Must-read papers on NLP for science.
ai ai4science awsome-list language-model moleculer nlp nlp4science paper-list pre-trained-model protein science survey transformer
49