roberta

There are 3 repositories under roberta topic.

ymcui / Chinese-BERT-wwm
Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）
bert bert-wwm bert-wwm-ext chinese-bert nlp pytorch rbt roberta roberta-wwm tensorflow
Language:Python 9325
microsoft / LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
adaptation deberta deep-learning gpt-2 gpt-3 language-model lora low-rank pytorch roberta
Language:Python 9222
bertviz
jessevig / bertviz
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
natural-language-processing machine-learning visualization neural-network pytorch nlp bert transformer gpt2 roberta transformers
Language:Python 6424
lonePatient / awesome-pretrained-chinese-nlp-models
Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合
chinese nlp pretrained-models bert roberta xlnet nezha ernie gpt gpt-2 nlu-nlg simbert pangu dataset llm large-language-models multimodel
Language:Python 4279
brightmart / albert_zh
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
albert bert roberta xlnet tensorflow pytorch pre-trained-model chinese-corpus pre-trained
Language:Python 3905
CLUEbenchmark / CLUE
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
nlu benchmark chinese corpus dataset bert albert chineseglue glue roberta language-model pretrained-models transformers tensorflow pytorch
Language:Python 3848
dbiir / UER-py
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
bert pre-training fine-tuning gpt chinese natural-language-processing pytorch elmo classification ner t5 unilm roberta albert clue gpt-2 model-zoo bart pegasus xlm-roberta
Language:Python 2916
brightmart / roberta_zh
RoBERTa中文预训练模型: RoBERTa for Chinese
roberta chinese bert pre-trained-language-models pre-trained gpt2
Language:Python 2537
guillaume-be / rust-bert
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
deep-learning nlp transformer bert rust-lang rust machine-learning ner sentiment-analysis question-answering language-generation gpt-2 roberta gpt bart electra translation
Language:Rust 2438
news-please
fhamborg / news-please
news-please - an integrated web crawler and information extractor for news that just works
news-crawler news-extractor crawler extractor news news-websites elasticsearch json python nlp data-gathering news-archive news-articles commoncrawl extract-articles extract-information news-scraper ccnews cc-news roberta
Language:Python 1944
microsoft / DeBERTa
The implementation of DeBERTa
bert deeplearning representation-learning roberta language-model natural-language-understanding self-attention transformer-encoder
Language:Python 1863
FARM
deepset-ai / FARM
:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
language-models bert nlp deep-learning transfer-learning pytorch nlp-library nlp-framework xlnet-pytorch ner question-answering pretrained-models roberta germanbert
Language:Python 1728
Tencent / TurboTransformers
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
albert bert decoder gpt2 gpu huggingface-transformers inference machine-translation nlp pytorch roberta transformer
Language:C++ 1442
CLUEbenchmark / CLUENER2020
CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition
ner chinese bert chinese-ner fine-grained-ner roberta named-entity-recognition sequence-labeling albert seq2seq sequence-to-sequence dataset chinesener
Language:Python 1406
920232796 / bert_seq2seq
pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。
bert seq2seq ner crf text-classification unilm pytorch roberta autotitle gpt2 t5-model
Language:Python 1264
Tencent / TencentPretrain
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
albert bart bert chinese classification clue elmo fine-tuning gpt gpt-2 model-zoo natural-language-processing ner pegasus pre-training pytorch roberta t5 unilm xlm-roberta
Language:Python 986
CLUEbenchmark / CLUECorpus2020
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
chinese chinese-corpus datasets pretrain corpus nlp bert roberta albert
886
grammarly / gector
Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)
grammatical-error-correction natural-language-processing sequence-labeling transformers roberta bert xlnet nlp text-simplification
Language:Python 864
explosion / curated-transformers
🤖 A PyTorch library of curated Transformer models and their composable components
bert dolly2 falcon gptneox llama llm nlp pytorch transformer xlm-roberta transformers albert camembert llms roberta
Language:Python 842
CLUEbenchmark / CLUEPretrainedModels
高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型
pretrained-models chinese bert roberta albert sentence-classification sentence-pairs semantic-similarity sentence-analysis text-classification distillation corpus dataset
Language:Python 788
asyml / texar-pytorch
Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/
machine-learning natural-language-processing pytorch deep-learning text-generation python machine-translation dialog-systems texar bert gpt-2 xlnet roberta text-data data-processing texar-pytorch casl-project
Language:Python 743
clue-ai / PromptCLUE
PromptCLUE, 全中文任务支持零样本学习模型
chinese gpt-3 multitask-learning pretrained-models t5-model zero-shot-learning few-shot-learning transfer-learning bert prompt-tuning roberta
Language:Jupyter Notebook 639
VinAIResearch / PhoBERT
PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)
bert bert-embeddings deep-learning fairseq language-models named-entity-recognition natural-language-inference ner nli part-of-speech-tagging phobert pos-tagging python3 rdrsegmenter roberta transformers transformers-library vietnamese vietnamese-nlp vncorenlp
628
rinnakk / japanese-pretrained-models
Code for producing Japanese pretrained models provided by rinna Co., Ltd.
nlp japanese gpt2 roberta
Language:Python 567
VinAIResearch / BERTweet
BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)
python3 bert roberta transformers fairseq language-model english part-of-speech-tagging ner named-entity-recognition text-classification sentiment-analysis irony-detection english-tweets covid-19 covid19 covid bertweet bertweet-covid19
Language:Python 561
KLUE-benchmark / KLUE
📖 Korean NLU Benchmark
benchmark bert korean korean-nlp roberta
544
EricFillion / happy-transformer
Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.
language-models artificial-intelligence ai question-answering bert roberta nlp machine-learning text-classification deep-learning transformers python natural-language-processing
Language:Python 505
hemingkx / CLUENER2020
A PyTorch implementation of a BiLSTM\BERT\Roberta(+CRF) model for Named Entity Recognition.
bert pytorch bert-crf roberta bilstm-crf ner named-entity-recognition
Language:Python 457
TransformerSum
HHousen / TransformerSum
Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.
automatic-summarization machine-learning extractive-summarization bert roberta distilbert albert summarization transformer-models pytorch-lightning summarization-dataset text-summarization
Language:Python 425
cliang1453 / BOND
BOND: BERT-Assisted Open-Domain Name Entity Recognition with Distant Supervision
ner named-entity-recognition distant-supervision roberta open-domain self-training weakly-supervised-learning weak-supervision weakly-supervised bert pre-trained fine-tuning natural-language-processing nlp dataset
Language:Python 289
dpressel / mint
MinT: Minimal Transformer Library and Tutorials
transformer-models transformer transformers pytorch bert gpt2 gpt bart t5 roberta sentence-transformers tutorials opt
Language:Python 241
brightmart / xlnet_zh
中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large
xlnet bert pre-train roberta language-model
Language:Python 228
iflytek / MiniRBT
MiniRBT (中文小型预训练模型系列)
bert pre-trained-model pytorch roberta tensorflow
Language:Python 216
sudharsan13296 / Getting-Started-with-Google-BERT
Build and train state-of-the-art natural language processing models using BERT
bert transformer huggingface-transformers albert roberta spanbert electra distilbert nlp pytorch videobert bart tinybert bertsum sentence-bert sbert clinical-bert
Language:Jupyter Notebook 208
liuyukid / transformers-ner
Pytorch-Named-Entity-Recognition-with-transformers
ner pytorch transformers bert electra roberta albert adversarial-training crf softmax span distilbert camembert xlm xlmroberta pgd fgm
Language:Python 207
amansrivastava17 / embedding-as-service
One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques
nlp bert xlnet word2vec glove fasttext ulmfit embedding transformer bert-as-service embedding-as-service sentence-encoding tensorflow word-embedding deep-learning ai encoder embeddings albert roberta
Language:Python 201