pre-trained-model

There are 14 repositories under pre-trained-model topic.

microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
nlp pre-trained-model unilm minilm layoutlm layoutxlm beit document-ai trocr beit-3 foundation-models xlm-e deepnet llm multimodal mllm kosmos kosmos-1 textdiffuser bitnet
Language:Python 21721
thunlp / OpenPrompt
An Open-Source Framework for Prompt-Learning.
nlp pre-trained-language-models ai nlp-machine-learning natural-language-processing natural-language-understanding deep-learning pre-trained-model nlp-library pytorch transformer prompt prompt-toolkit prompts prompt-based-tuning prompt-learning
Language:Python 4724
brightmart / albert_zh
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
albert bert roberta xlnet tensorflow pytorch pre-trained-model chinese-corpus pre-trained
Language:Python 3985
ChineseGLUE / ChineseGLUE
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
glue language-understanding bert pre-trained-model chinese-corpus nlp albert datasets
Language:Python 1781
ymcui / Chinese-ELECTRA
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
bert chinese chinese-electra electra language-model nlp pre-trained-model pytorch tensorflow
Language:Python 1414
SparK
keyu-tian / SparK
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
bert convnet convolutional-neural-networks masked-image-modeling pre-trained-model self-supervised-learning sparse-convolution ssl cnn iclr iclr2023 deep-learning object-detection pytorch instance-segmentation mask-rcnn mae masked-autoencoder pretrain pretraining
Language:Python 1355
zjunlp / KnowLM
An Open-sourced Knowledgable Large Language Model Framework.
llama large-language-models pre-trained-language-models language-model instruction-following deep-learning chinese english instructions models reasoning gpt-3 deepspeed instruction-tuning lora pre-training bilingual pre-trained-model knowlm instructie
Language:Python 1341
d-li14 / involution
[CVPR 2021] Involution: Inverting the Inherence of Convolution for Visual Recognition, a brand new neural operator
involution operator pytorch image-classification object-detection instance-segmentation semantic-segmentation cvpr2021 pre-trained-model
Language:Python 1314
zjunlp / KnowledgeEditingPapers
Must-read Papers on Knowledge Editing for Large Language Models.
awsome-list easyedit foundation-models knowledge-editing knowlm large-language-models model-editing natural-language-processing paper paper-list pre-trained-language-models pre-trained-model review rome survey
1055
NVlabs / FasterViT
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
ade20k backbone deep-learning image-net pre-trained-model self-attention vision-transformer visual-recognition coco object-detection semantic-segmentation foundation-models image-classification
Language:Python 878
deepmodeling / Uni-Mol
Official Repository for the Uni-Mol Series Methods
deep-learning molecular-modeling pre-trained-model pretraining
Language:Python 827
ModelsGenesis
MrGiovanni / ModelsGenesis
[MICCAI 2019 Young Scientist Award] [MEDIA 2020 Best Paper Award] Models Genesis
fine-tuning representation-learning transfer-learning self-supervised-learning 3d-model pre-trained-model foundation-models
Language:Jupyter Notebook 771
salesforce / PCL
PyTorch code for "Prototypical Contrastive Learning of Unsupervised Representations"
representation-learning self-supervised-learning unsupervsied-learning contrastive-learning pre-trained-model
Language:Python 598
mims-harvard / TFC-pretraining
Self-supervised contrastive learning for time series via time-frequency consistency
consistency-models contrastive-learning deep-learning pre-trained-model representation-learning self-supervised-learning time-series
Language:Python 499
edenai / edenai-apis
Eden AI: simplify the use and deployment of AI technologies by providing a unique API that connects to the best possible AI engines
aggregator ai ai-as-a-service api computer-vision document-parsing image-processing machine-translation natural-language-processing nlp ocr optical-character-recognition pre-trained-model python speech-recognition speech-to-text text-to-speech video-recognition
Language:Python 442
NVlabs / GCVit
[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
ade20k backbone coco deep-learning imagenet imagenet-classification object-detection pre-train pre-trained-model self-attention semantic-segmentation vision-transformer visual-recognition
Language:Python 429
HKUDS / UrbanGPT
[KDD'2024] "UrbanGPT: Spatio-Temporal Large Language Models"
fundation-models instruction-tuning large-language-models pre-trained-model smart-cities spatio-temporal-prediction urban-computing urban-data-science
Language:Python 387
SuPreM
MrGiovanni / SuPreM
[ICLR 2024 Oral] Supervised Pre-Trained 3D Models for Medical Image Analysis (9,262 CT volumes + 25 annotated classes)
dataset medical-imaging pre-trained-model segmentation transfer-learning representation-learning supervised-learning foundation-models foundational-datasets
Language:Python 367
ymcui / PERT
PERT: Pre-training BERT with Permuted Language Model
pre-trained-model bert nlp plm tensorflow pytorch transformers
359
nogibjj / rust-mlops-template
A work in progress to build out solutions in Rust for MLOPs
mlops gpu huggingface pytorch rust actix-web aws azure cloud copilot devcontainers microservices polars tensorflow devops gil mlops-workflow onnx pre-trained-model switchtorust
Language:Rust 358
iflytek / MiniRBT
MiniRBT (中文小型预训练模型系列)
bert pre-trained-model pytorch roberta tensorflow
Language:Python 293
hjbahng / visual_prompting
Exploring Visual Prompts for Adapting Large-Scale Models
pre-trained-model prompt-tuning pytorch visual-prompting transfer-learning
Language:Python 277
ZhangYuanhan-AI / NOAH
[TPAMI] Searching prompt modules for parameter-efficient transfer learning.
prompt-tuning transfer-learning domain-generalization visual-prompting pre-trained-model pytorch deep-learning
Language:Python 228
rsommerfeld / trocr
Powerful handwritten text recognition. A simple-to-use, unofficial implementation of the paper "TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models".
trocr ocr handwritten-text-recognition transformer computer-vision pre-trained-model
Language:Python 216
YuanchenBei / Awesome-Pretraining-for-Graph-Neural-Networks
A curated list of papers on pre-training for graph neural networks (Pre-train4GNN).
fine-tuning graph-neural-networks pre-trained-model pre-training graph-pretraining graph graph-algorithms
193
audio-pretrained-model
balavenkatesh3322 / audio-pretrained-model
A collection of Audio and Speech pre-trained models.
pre-trained-model pre-trained pre-training tensorflow keras keras-tensorflow neural-network mxnet machine-learning python3 caffe keras-models tensorflow-models pytorch pytorch-models audio speech-recognition speech-to-text audio-processing
188
YicongHong / Recurrent-VLN-BERT
Code of the CVPR 2021 Oral paper: A Recurrent Vision-and-Language BERT for Navigation
bert cvpr-oral cvpr2021 pre-trained-model transformer vision-and-language vision-and-language-navigation
Language:Python 170
zjunlp / MolGen
[ICLR 2024] Domain-Agnostic Molecular Generation with Chemical Feedback
language-model molecular-generation pre-trained-language-models pre-trained-model molgen molecule molecular-optimization selfies targeted-molecular-generation pre-training generation multitask huggingface pytorch iclr2024
Language:Python 155
HKUDS / HiGPT
[KDD'2024] "HiGPT: Heterogenous Graph Language Models"
fundation-models graph-learning graph-model graph-neural-networks instruction-tuning large-language-models pre-trained-model
Language:Python 124
siat-nlp / GALAXY
Official repository of the AAAI'2022 paper "GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injection"
dialogue-generation pre-trained-model semi-supervised task-oriented-dialogue
Language:Python 107
helicalAI / helical
This repository contains the python package for Helical
artificial-intelligence bioinformatics biology data deep-learning dna-sequences foundation-models gene-expression neural-networks pre-trained-model pre-training rna-seq rnaseq transformer vcf evo-2 scgpt uce geneformer
Language:Python 106
lyy1994 / awesome-data-contamination
The Paper List on Data Contamination for Large Language Models Evaluation.
evaluation foundation-models large-language-models llm data-contamination awesome-list paper-list pre-trained-language-models pre-trained-model
91
HKUDS / GPT-ST
[NeurIPS'2023] "GPT-ST: Generative Pre-Training of Spatio-Temporal Graph Neural Networks"
generative-model graph-neural-networks pre-trained-model spatio-temporal-prediction urban-computing
Language:Python 82
RL4M / MRM-pytorch
An official implementation of Advancing Radiograph Representation Learning with Masked Record Modeling (ICLR'23)
chest-xray-images multi-modal-learning pre-trained-model representation-learning self-supervised-learning
Language:Python 79
RUCAIBox / MVP
This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural Language Generation.
nlp dialog natural-language-processing question-answering seq2seq summarization text-generation sequence-to-sequence data-to-text natural-language-generation nlg question-generation story-generation multi-task-learning plm pre-trained-model
72
CGCL-codes / AdvEncoder
The implementation of our ICCV 2023 paper "Downstream-agnostic Adversarial Examples"
adversarial-examples pre-trained-model
Language:Python 68