FreeGodCode

Chinese-Text-Classification

Chinese-Text-Classification Project including bert-classification, textCNN and so on.

ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

BERT-pytorch

Google AI 2018 BERT pytorch implementation

Awesome-Chinese-LLM

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

baby-llama2-chinese

用于从头预训练+SFT一个小参数量的中文LLaMa2的仓库；24G单卡即可运行得到一个具备简单中文问答能力的chat-llama2.

AutoFP8

AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

LangGPT

LangGPT: Empowering everyone to become a prompt expert!🚀 Structured Prompt，Language of GPT, 结构化提示词，结构化Prompt

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

LLM-Dojo

欢迎来到 LLM-Dojo，这里是一个开源大模型学习场所，使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩‍🎓👨‍🎓

WikiHowQAExtractor-mnbvc

Extract Chinese/English QA Data from WikiHow pages.

MNBVC

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

AIScripts

Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub

llama.cpp

LLM inference in C/C++

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

ChatLaw

ChatLaw：A Powerful LLM Tailored for Chinese Legal. 中文法律大模型

text2vec

text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。

ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

generate

A Python Package to Access World-Class Generative Models

masr

中文语音识别; Mandarin Automatic Speech Recognition;

PaddleSpeech

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

DeepSpeech

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

CLIP

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

awesome-microservices

A curated list of Microservice Architecture related principles and technologies.

fdfs_client-py

fastdfs python client compatible with ver 4.0.6

learn-regex-zh

:cn: 翻译: 学习正则表达式的简单方法

awesome-machine-learning

A curated list of awesome Machine Learning frameworks, libraries and software.

system-design-primer

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.