LKChenLK

angular

Deliver web apps with confidence 🚀

typst

A new markup-based typesetting system that is powerful and easy to learn.

analytics

Simple, open source, lightweight (< 1 KB) and privacy-friendly web analytics alternative to Google Analytics.

pyo3

Rust bindings for the Python interpreter

Chinese-BERT-wwm

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

owncast

Take control over your live stream video by running it yourself. Streaming + chat out of the box.

axolotl

Go ahead and axolotl questions

pipreqs

pipreqs - Generate pip requirements.txt file based on imports of any project. Looking for maintainers to move this project forward.

presidio

Context aware, pluggable and customizable data protection and de-identification SDK for text and images

ImageOptim-CLI

Make optimisation of images part of your automated build process

roberta_zh

RoBERTa中文预训练模型: RoBERTa for Chinese

data-juicer

A one-stop data processing system to make data higher-quality, juicier, and more digestible for (multimodal) LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

hunspell

The most popular spellchecking library.

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

llm-guard

The Security Toolkit for LLM Interactions

nanotron

Minimalistic large language model 3D-parallelism training

TransformerLens

A library for mechanistic interpretability of GPT-style language models

awesome-instruction-learning

Papers and Datasets on Instruction Tuning and Following. ✨✨✨

csvdedupe

:id: Command line tool for deduplicating CSV files

unintended-ml-bias-analysis

llamafia.github

PainlessInferenceAcceleration

piicatcher

Scan databases and data warehouses for PII data. Tag tables and columns in data catalogs like Amundsen and Datahub

MR-Models

聯發創新基地（MediaTek Research) 致力於研究基礎模型。我們將研究體現在適合繁體中文使用者的模型上，並在使用權許可的情況下，提供模型給學術界研究或產業界使用。

conversationai-models

A repository to house model building experiments and tools that are part of the Conversation AI effort.

pandas_dq

Find data quality issues and clean your data in a single line of code with a Scikit-Learn compatible Transformer.

c4-dataset-script

Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese data processing and cleaning methods in MassiveText.

features-across-time

Understanding how features learned by neural networks evolve throughout training

edos

Public repository for SemEval 2023 - Task 10 - Explainable Detection of Online Sexism (EDOS)

perspectiveapi-proxy

Example code for an authenticated proxy for requests to the Perspective API