There are 3 repositories under roberta topic.
Pre-Training with Whole Word Masking for Chinese BERT(中文BERT-wwm系列模型)
Awesome Pretrained Chinese NLP Models,高质量中文预训练模型&大模型&多模态模型&大语言模型集合
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
RoBERTa中文预训练模型: RoBERTa for Chinese
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
news-please - an integrated web crawler and information extractor for news that just works
:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition
pytorch实现 Bert 做seq2seq任务,使用unilm方案,现在也可以做自动摘要,文本分类,情感分析,NER,词性标注等任务,支持t5模型,支持GPT2进行文章续写。
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
🤖 A PyTorch library of curated Transformer models and their composable components
高质量中文预训练模型集合:最先进大模型、最快小模型、相似度专门模型
Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/
PromptCLUE, 全中文任务支持零样本学习模型
PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)
Code for producing Japanese pretrained models provided by rinna Co., Ltd.
BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)
Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.
A PyTorch implementation of a BiLSTM\BERT\Roberta(+CRF) model for Named Entity Recognition.
Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.
BOND: BERT-Assisted Open-Domain Name Entity Recognition with Distant Supervision
中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large
Build and train state-of-the-art natural language processing models using BERT
Pytorch-Named-Entity-Recognition-with-transformers
One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques