There are 1 repository under pretrain topic.
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
Firefly中文LLaMA-2大模型,支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型
Paper Lists, Notes and Slides, Focus on NLP. For summarization, please refer to https://github.com/xcfcode/Summarization-Papers
BERT-CCPoem is an BERT-based pre-trained model particularly for Chinese classical poetry
Bert-based models(BERT, MTB, CP) for relation extraction.
MatDGL is a neural network package that allows researchers to train custom models for crystal modeling tasks. It aims to accelerate the research and application of material science.
code for paper "Masked Frequency Modeling for Self-Supervised Visual Pre-Training" (https://arxiv.org/pdf/2206.07706.pdf)
ALBERT trained on Mongolian text corpus
Official code repository for the paper "Pushing the Limits of Pre-training for Time Series Forecasting in the CloudOps Domain"
[CCIR 2023] Self-supervised learning for Sequential Recommender Systems
macrogpt大模型全量预训练(1b3,32层), 多卡deepspeed/单卡adafactor
This repository provides code solution for Data Fusion Contest task 1
Understanding "A Lite BERT". An Transformer approach for learning self-supervised Language Models.
Parsing Hoyoverse game text corpus from public wikipedia
This project is about to detecting the text generated by different LLM given prompt. The instance is labeled by Human and Machine, and this project utilised both traditional machine learning method and deep learning method to classify the instance.
🎓Automatically Update CV Papers Daily using Github Actions (Update Every 24th hours)