welliechen

LLM-Jailbreaking-Defense-Backtranslation

Code for paper "Defending aginast LLM Jailbreaking via Backtranslation"

RefGPT

sdft

[ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".

AutoDefense

AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks

CValues

面向中文大模型价值观的评估与对齐研究

PurpleLlama

Set of tools to assess and improve LLM security.

EasyJailbreak

An easy-to-use Python framework to generate adversarial jailbreak prompts.

Safety-Prompts

Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts，用于评估和提升大模型的安全性。

ragas

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

llm-sp

Papers and resources related to the security and privacy of LLMs 🤖

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

brew

🍺 The missing package manager for macOS (or Linux)

SimCSE

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821

pyFM

Factorization machines in python

DeepTables

DeepTables: Deep-learning Toolkit for Tabular data

SIFRank_zh

Keyphrase or Keyword Extraction 基于预训练模型的中文关键词抽取方法（论文SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-trained Language Model 的中文版代码）

ParlAI

A framework for training and evaluating AI models on a variety of openly available dialogue datasets.

DeepCTR

Easy-to-use,Modular and Extendible package of deep-learning based CTR models .

ANCE

A novel embedding training algorithm leveraging ANN search and achieved SOTA retrieval on Trec DL 2019 and OpenQA benchmarks

HiTransformer

ACL 2021: HiTransformer

KeyBERT

Minimal keyword extraction with BERT

awesome-gpt3

chatbot

ChatGPT带火了聊天机器人，主流的趋势都调整到了GPT类模式，本项目也与时俱进，会在近期更新GPT类版本。基于本项目和自己的语料可以训练出自己想要的聊天机器人，用于智能客服、在线问答、闲聊等场景。

Sentiment-Analysis

该资源为调用大连理工情感词典实现的情感分析和情绪分类，并与SnowNLP进行对比。基础性文章，希望对您有所帮助~

sighan_raw

SIGHAN中文纠错数据集及转换后格式

BertSum

Code for paper Fine-tune BERT for Extractive Summarization

bertsum-chinese

chinese bertsum ； bertsum 抽取式模型中文版本；给出案例数据、全代码注释；下载即可训练、预测、学习

MatchSum

Code for ACL 2020 paper: "Extractive Summarization as Text Matching"

CLUE

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

SBERT-WK-Sentence-Embedding

IEEE/ACM TASLP 2020: SBERT-WK: A Sentence Embedding Method By Dissecting BERT-based Word Models