masked-language-modeling

There are 2 repositories under masked-language-modeling topic.

ShiZhengyan / PowerfulPromptFT
[NeurIPS 2023 Main Track] This is the repository for the paper titled "Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner"
continue-learning fine-tuning instruction-tuning language-model pretraining prompt-engineering prompt-tuning in-context-learning masked-language-modeling masked-language-models prompt-based-tuning prompt-learning prompting semi-supervised semi-supervised-learning
Language:Python 75
DunnBC22 / NLP_Projects
Repository for My HuggingFace Natural Language Processing Projects
machine-translation semantic-similarity text-classification text-regression text-summarization multilabel-classification sentiment-analysis binary-classification causal-language-modeling huggingface language-detection masked-language-modeling multiclass-classification multiple-choice-question-answering question-answering text-classificaiton-with-bert text-classification-multi-label
Language:Jupyter Notebook 31
AndyShih12 / mac
PyTorch implementation for "Training and Inference on Any-Order Autoregressive Models the Right Way", NeurIPS 2022 Oral, TPM 2023 Best Paper Honorable Mention
autoregressive-models generative-models masked-image-modeling masked-language-modeling pytorch tractable-inference tractable-models any-order-autoregressive-models
Language:Python 15
dangnh0611 / kaggle_leash_belka
11th place solution of NeurIPS 2024 - Predict New Medicines with BELKA competition on Kaggle: https://www.kaggle.com/competitions/leash-BELKA
belka binding bio chemistry drug-discovery fingerprint leash masked-language-modeling molecule pretraining protein-ligand-interactions self-supervised-learning smiles-strings graph-neural-network kaggle qsar
Language:Jupyter Notebook 8
rishub-tamirisa / transformer-mlm
Implementation of Transformer Encoders / Masked Language Modeling Objective
deep-learning masked-language-modeling nlp bert educational encoder pytorch transformer
Language:Python 7
an-seunghwan / MaCoDE
Official implementation of 'Masked Language Modeling Becomes Conditional Density Estimation for Tabular Data Synthesis' (MaCoDE) with pytorch (AAAI 2025 accepted paper).
masked-language-modeling missing-data-imputation mlm synthetic-data-generation missing-data synthetic-data distributional-learning
Language:Jupyter Notebook 4
vive_la_ner
viktor-shcherb / vive_la_ner
The default way to fine-tune BERT is wrong. Here is why
bert deep-learning experiments fine-tuning huggingface-transformers knowledge-transfer masked-language-modeling multilingual-nlp named-entity-recognition natural-language-processing ner pytorch representation-learning research sequence-tagging token-classification transfer-learning transformers xlm-roberta ml-best-practices
Language:Jupyter Notebook 4
zalkikar / mlm-bias
Measuring Biases in Masked Language Models for PyTorch Transformers. Support for multiple social biases and evaluation measures.
bias-evaluation computational-social-science explainable-ai explainable-ml huggingface interpretable-ai interpretable-ml machine-learning masked-language-modeling masked-language-models pytorch transformers
Language:Python 4
aidausmanova / T5_pretraining_finetuning
Continue T5 MLM pre-training on verbalized ConceptNet and fine-tune for commonsense question-answering
fine-tuning-llm masked-language-modeling t5-model
Language:Jupyter Notebook 2
iamlxb3 / PMTC
Code for the publication of WWW'22
byte-pair-encoding mmorpg representation-learning masked-language-modeling player-behavioral-sequences user-behavioral-sequences
Language:Python 2
shockless / asr-transformer
Transformer for Automatic Speech Recognition
asr masked-language-modeling spectrogram transformer
Language:Python 2
Anshumaan-Chauhan02 / CheMapBERT
External Knowledge Infusion using INCIDecoder into BERT for Chemical Mapping
bert-classifier masked-language-modeling fine-tuning-bert knowledge-infusion classification python weight-transfer
Language:Jupyter Notebook 1
emrecncelik / zeroshot-turkish
Evaluation of zero-shot classification models on Turkish datasets.
masked-language-modeling natural-language-inference next-sentence-prediction text-classification transformers zero-shot-classification
Language:Jupyter Notebook 1
nabeelshan78 / Transformer-Adaptation-Playbook
An empirical study of Transformer adaptation techniques. Pre-training from scratch (MLM), classic fine-tuning, and from-scratch implementations of PEFT methods (LoRA, Adapters). Tuning both encoder (BERT) and decoder (OPT) models.
adapters bert deep-learning fine-tuning gpt instruction-tuning lora masked-language-modeling natural-language-processing peft pretraining pytorch sentiment-analysis text-generation transformers
Language:Jupyter Notebook 1
NipunRathore / NLP-Transformers-from-Scratch
Pre-training a Transformer from scratch.
attention-mechanism bert encoder-decoder fine-tuning gpt hyperparameter-tuning masked-language-modeling next-sentence-prediction nlp pre-training transformer-models transformers
Language:Jupyter Notebook 1
pszemraj / annotated-mpnet
Raw Torch, heavily annotated, pretrainable MPNet
encoder masked-language-modeling mpnet transformers
Language:Python 1
Amir79Naziri / SpellCorrectionML
Source codes and materials of Advanced Spelling Error Correction project.
adam-optimizer bert-fine-tuning bert-model masked-language-modeling neural-networks parsbert spelling-correction hugging-face-api hugging-face-transformers
Language:Python 0
DarshanAdiga / bertram-on-magpie
Use BERTRAM to get single-token embeddings for idioms on the MAGPIE dataset.
bert-model magpie masked-language-modeling transformers word-embeddings idiomaticity
Language:Python 0
LazerLambda / udl-negation
Comparing Data-Driven Techniques for Enhancing Negation Sensitivity in MLM-Based Laguage-Models
bert computational-linguistics deep-learning deeplearning dl encoder machine-learning masked-language-modeling ml negation nlp nlu python research statistics torch transformers
Language:Jupyter Notebook 0
mojtabasajjadi / FarSSiBERT
A Pre-trained Language Model for Semantic Similarity Measurement of Persian Informal Short Texts
bert informal-texts llms masked-language-modeling paraphrase-identification pre-trained-language-models persian-short-texts social-network-data
Language:Python 0
pszemraj / NeoBERT
fork of NeoBERT refactored for easier experimentation, WIP
bert-model contrastive-learning encoder-model masked-language-modeling pretraining
Language:Python 0
pyyush / MLM
Masked Language Modeling demo using XLM-RoBERTa + Gradio/FastAPI
demo fastapi gradio inference llm masked-language-modeling natural-language-processing xlm-roberta
Language:Python 0
FaNa-AI / SLM
A small-scale language model implementation using GPT2 for text generation in Persian and English. This project is designed for fast experimentation, minimal setup, and bilingual prompt generation.
fine-tuning hugging-face language-modeling masked-language-modeling slm transformers tokenization gpt2 small-language-model text-generation causal-language-model
Language:Jupyter Notebook
moon23k / CPT
Customized Pretraining for NLG Tasks
masked-language-modeling nlg pretraining transformer casual-language-modeling masked-casual-language-modeling
Language:Python
PastelBelem8 / ml4nlp-cogsci-summer22
Course materials for the Machine Learning for NLP course taught by Sameer Singh for the Cognitive Science summer school 2022.
nlp causal-language-modeling few-shot-learning gpt-2 gpt-3 masked-language-modeling nlp-machine-learning word-embeddings zero-shot-learning tk-instruct
Language:Jupyter Notebook
paulicuu / depsev-analysis
Data-driven approaches for identifying depression severity in social media posts.
bilstm data-augmentation data-imbalance distilbert glove-embeddings masked-language-modeling nlp sentence-embeddings tf-idf
Language:Jupyter Notebook
reshalfahsi / mlm-bert-multi-gpu
Masked Language Modeling with BERT in Multi-GPU Settings
accelerate bert huggingface masked-language-modeling multi-gpu
Language:Jupyter Notebook
selcia25 / text-analysis
🗨️ This repository contains a collection of notebooks and resources for various NLP tasks using different architectures and frameworks.
bert-model bidirectional-lstm conll-2003 distilbert-model huggingface-transformers imdb-dataset keras language-model masked-language-modeling named-entity-recognition python question-answering scikit-learn single-layered-neural-network squad-dataset tensorflow text-classification transformer
Language:Jupyter Notebook

masked-language-modeling

ShiZhengyan / PowerfulPromptFT

DunnBC22 / NLP_Projects

AndyShih12 / mac

dangnh0611 / kaggle_leash_belka

rishub-tamirisa / transformer-mlm

an-seunghwan / MaCoDE

viktor-shcherb / vive_la_ner

zalkikar / mlm-bias

aidausmanova / T5_pretraining_finetuning

iamlxb3 / PMTC

shockless / asr-transformer

Anshumaan-Chauhan02 / CheMapBERT

emrecncelik / zeroshot-turkish

nabeelshan78 / Transformer-Adaptation-Playbook

NipunRathore / NLP-Transformers-from-Scratch

pszemraj / annotated-mpnet

Amir79Naziri / SpellCorrectionML

DarshanAdiga / bertram-on-magpie

LazerLambda / udl-negation

mojtabasajjadi / FarSSiBERT

pszemraj / NeoBERT

pyyush / MLM

FaNa-AI / SLM

moon23k / CPT

PastelBelem8 / ml4nlp-cogsci-summer22

paulicuu / depsev-analysis

reshalfahsi / mlm-bert-multi-gpu

selcia25 / text-analysis