pre-trained-language-models

There are 8 repositories under pre-trained-language-models topic.

Chinese-LLaMA-Alpaca
ymcui / Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
alpaca alpaca-2 large-language-models llama llama-2 llm lora nlp plm pre-trained-language-models quantization
Language:Python 18940
RUCAIBox / LLMSurvey
The official GitHub page for the survey paper "A Survey of Large Language Models".
chain-of-thought chatgpt in-context-learning instruction-tuning large-language-models llm llms natural-language-processing pre-trained-language-models pre-training rlhf
Language:Python 11947
thunlp / OpenPrompt
An Open-Source Framework for Prompt-Learning.
nlp pre-trained-language-models ai nlp-machine-learning natural-language-processing natural-language-understanding deep-learning pre-trained-model nlp-library pytorch transformer prompt prompt-toolkit prompts prompt-based-tuning prompt-learning
Language:Python 4759
thunlp / PromptPapers
Must-read papers on prompt-based tuning for pre-trained language models.
nlp pre-trained-language-models ai machine-learning bert prompt-toolkit prompt prompt-learning prompt-based
4292
ddangelov / Top2Vec
Top2Vec learns jointly embedded topic, document and word vectors.
bert document-embedding pre-trained-language-models semantic-search sentence-encoder sentence-transformers text-search text-semantic-similarity top2vec topic-modeling topic-modelling topic-search topic-vector word-embeddings
Language:Python 3094
brightmart / roberta_zh
RoBERTa中文预训练模型: RoBERTa for Chinese
roberta chinese bert pre-trained-language-models pre-trained gpt2
Language:Python 2755
zjunlp / KnowLM
An Open-sourced Knowledgable Large Language Model Framework.
llama large-language-models pre-trained-language-models language-model instruction-following deep-learning chinese english instructions models reasoning gpt-3 deepspeed instruction-tuning lora pre-training bilingual pre-trained-model knowlm instructie
Language:Python 1353
zjunlp / KnowledgeEditingPapers
Must-read Papers on Knowledge Editing for Large Language Models.
awsome-list easyedit foundation-models knowledge-editing knowlm large-language-models model-editing natural-language-processing paper paper-list pre-trained-language-models pre-trained-model review rome survey
1192
cedrickchee / awesome-transformer-nlp
A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
nlp natural-language-processing bert transformer language-model transfer-learning attention-mechanism awesome-list gpt-2 xlnet neural-networks pre-trained-language-models gpt-3 awesome chatgpt gpt-4 llama
1116
THUDM / P-tuning
A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
few-shot-learning natural-language-processing p-tuning parameter-efficient-learning pre-trained-language-models prompt-tuning
Language:Python 937
txsun1997 / LMaaS-Papers
Awesome papers on Language-Model-as-a-Service (LMaaS)
ai gpt-3 machine-learning natural-language-processing nlp paper-list pre-trained-language-models prompt-learning prompt-tuning
548
sunyilgdx / SIFRank_zh
Keyphrase or Keyword Extraction 基于预训练模型的中文关键词抽取方法（论文SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-trained Language Model 的中文版代码）
elmo keyphrase-extraction keyword-extraction pre-trained-language-models python36 sentence-embeddings sif sifrank word-embeddings
Language:Python 431
airaria / TextPruner
A PyTorch-based model pruning toolkit for pre-trained language models
model-pruning pre-trained-language-models pruning transformer
Language:Python 390
wjn1996 / HugNLP
HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NLP now!😊 HugNLP will released to @HugAILab
code-understanding deep-learning few-shot-learning knowledge-enhancement natural-language-processing pre-trained-language-models prompt-based-learning pytorch semi-supervised-learning supervised-learning transformers
Language:Python 242
zjunlp / MolGen
[ICLR 2024] Domain-Agnostic Molecular Generation with Chemical Feedback
language-model molecular-generation pre-trained-language-models pre-trained-model molgen molecule molecular-optimization selfies targeted-molecular-generation pre-training generation multitask huggingface pytorch iclr2024
Language:Python 180
zjunlp / MKG_Analogy
[ICLR 2023] Multimodal Analogical Reasoning over Knowledge Graphs
analogy kg analogical-reasoning dataset knowledge-graph multimodal computer-vision natural-language-processing mars markg iclr2023 iclr reasoning language-model pre-trained-language-models prompt
Language:Python 131
zjunlp / DART
[ICLR 2022] Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners
prompt-tuning pre-trained-language-models few-shot-learning prompt dart prompt-learning iclr iclr2022 pytorch language-models
Language:Python 129
sunyilgdx / SIFRank
The code of our paper "SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-trained Language Model"
keywords-extraction keyphrase-extraction python3 elmo sif pre-trained-language-models word-embeddings stanfordcorenlp
Language:Python 122
TobiasLee / Awesome-Efficient-PLM
Must-read papers on improving efficiency for pre-trained language models.
model-compression paper-list pre-trained-language-models
105
lyy1994 / awesome-data-contamination
The Paper List on Data Contamination for Large Language Models Evaluation.
evaluation foundation-models large-language-models llm data-contamination awesome-list paper-list pre-trained-language-models pre-trained-model
102
Hanlard / Electra_CRF_NER
We start a company-name recognition task with a small scale and low quality training data, then using skills to enhanced model training speed and predicting performance with least artificial participation. The methods we use involve lite pre-training models such as Albert-small or Electra-small with financial corpus, knowledge of distillation and multi-stage learning. The result is that we improve the recall rate of company names recognition task from 0.73 to 0.92 and get 4 times as fast as BERT-Bilstm-CRF model.
bert distilling-the-knowledge financial mutistage-learning ner pre-trained-language-models
Language:Python 81
Victorwz / VaLM
VaLM: Visually-augmented Language Modeling. ICLR 2023.
deep-learning pre-trained-language-models vision-language visually-grounded-language-learning
Language:Python 56
zjunlp / ChatCell
ChatCell: Facilitating Single-Cell Analysis with Natural Language
ai4science artificial-intelligence bioinformatics biology cell chatcell interdisciplinary large-language-models llm4bio natural-language-processing pre-trained-language-models single-cell single-cell-analysis
Language:Python 52
WangRongsheng / Chinese-LLaMA-Alpaca-Usage
📔 对Chinese-LLaMA-Alpaca进行使用说明和核心代码注解
alpaca fine-tuning large-language-models llama llm llms lora pre-trained-language-models webui
Language:Jupyter Notebook 50
pat-jj / TagReal
[ACL'23] Open KG Completion with PLM (Bridging Text Mining and Prompt Engineering)
deep-learning knowledge-graph nlp pre-trained-language-models
Language:Python 43
lancopku / DynamicKD
Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models"
nlp pre-trained-language-models knowledge-distillation
Language:Python 41
ai2-ner-project / pytorch-ko-ner
PLM 기반 한국어 개체명 인식 (NER)
huggingface korean korean-nlp named-entity-recognition pre-trained-language-models pytorch
Language:Python 30
lanwuwei / GigaBERT
Zero-shot Transfer Learning from English to Arabic
pre-trained-language-models arabic-nlp bert-model named-entity-recognition part-of-speech-tagging relation-extraction
Language:Python 30
westlake-repl / Multimodal-recommendation-datasets
A repository listing important datasets for multimodal recommender systems
cross-domain-recommendation foundation-recommendation-model image-recommendation multi-domain-recommendation multimodal-recommendation multimodal-recommendation-dataset pre-trained-language-models text-recommendation transferable-recommendation llm-recommendation
26
xuanyuan14 / ARES
SIGIR'22 paper: Axiomatically Regularized Pre-training for Ad hoc Search
pre-trained-language-models pretrained-models sigir2022 information-retrieval bert transformer natural-language-processing
Language:Python 24
cliang1453 / super-structured-lottery-tickets
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization (ACL 2021)
acl2021 bert-fine-tuning generalization lottery-ticket-hypothesis lottery-tickets model-compression model-pruning multi-task-learning natural-language-understanding pre-trained-language-models
Language:Python 19
nkcs-iclab / linglong
LingLong (玲珑): a small-scale Chinese pretrained language model
chinese-language-model gpt-3 pre-trained-language-models
Language:Python 19
XingLuxi / Cal-FLOPs-for-PLM
Calculating FLOPs of Pre-trained Models in NLP
flops natural-language-processing parameters pre-trained-language-models pytorch transformers
Language:Python 18
yuzhimanhua / SeeTopic
Seed-Guided Topic Discovery with Out-of-Vocabulary Seeds (NAACL'22)
pre-trained-language-models topic-discovery topic-modeling
Language:C 18
zjunlp / knowledge-rumination
[EMNLP 2023] Knowledge Rumination for Pre-trained Language Models
commonsense-reasoning gpt-3 large-language-models natural-language-processing pre-trained-language-models prompt-engineering pytorch question-answering knowledge-rumination
Language:Python 17
Shaun-le / ViQAG
Question and answer generation (QAG) is a natural language processing (NLP) task that generates a question and an answer in the same time by using context information. The input context can be represented in form of structured information in a database or raw text. The outputs of QAG systems can be directly applied to several NLP applications...
large-language-models llama2 pre-trained-language-models question-and-answer-generation
Language:Python 13