zye1996

DocumentLayoutAnalysis

Document Layout Analysis resources repos for development with PdfPig.

CnSTD

CnSTD: 基于 PyTorch/MXNet 的 中文/英文 场景文字检测（Scene Text Detection）、数学公式检测（Mathematical Formula Detection, MFD）、篇章分析（Layout Analysis）的Python3 包

PaddleOCR2Pytorch

PaddleOCR inference in PyTorch. Converted from [PaddleOCR](https://github.com/PaddlePaddle/PaddleOCR)

GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

ai

Build AI-powered applications with React, Svelte, Vue, and Solid

BitNet

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

AutoPrompt

A framework for prompt tuning using Intent-based Prompt Calibration

Chinese-medical-dialogue-data

Chinese medical dialogue data 中文医疗对话数据集

vearch

Distributed vector search for AI-native applications

LESS

[ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning

magika

Detect file content types with deep learning

jieba

结巴中文分词

speechbrain

A PyTorch-based Speech Toolkit

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

TikTalk

gutenberg-dialog

Build a dialog dataset from online books in many languages

ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

MuTual

A Dataset for Multi-Turn Dialogue Reasoning

conversational-datasets

Large datasets for conversational AI

tvsub

TVsub: DCU-Tencent Chinese-English Dialogue Corpus

LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

OLMo

Modeling, training, eval, and inference code for OLMo

clean-dialog

A framework for cleaning Chinese dialog data

CDial-GPT

A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models

chinese-chatbot-corpus

中文公开聊天语料库

MiniCPM

MiniCPM-2B: An end-side LLM outperforming Llama2-13B.

ColBERT

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)

Luotuo-Chinese-LLM

骆驼(Luotuo): Open Sourced Chinese Language Models. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技

Luotuo-Text-Embedding

Luotuo Embedding(骆驼嵌入) is a text embedding model, which developed by 李鲁鲁, 冷子昂, 陈启源, 蒟蒻等.