zhangwei730

FlagEmbedding

Retrieval and Retrieval-augmented LLMs

doctr

docTR (Document Text Recognition) - a seamless, high-performing & accessible library for OCR-related tasks powered by Deep Learning.

LLaMA-Factory

Unify Efficient Fine-Tuning of 100+ LLMs

GLM-4

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

SwinDocSegmenter

[ICDAR 2023] (Oral) An End-to-End Unified Domain Adaptive Transformer for Document Instance Segmentation

AdvancedLiterateMachinery

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.

MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

ERNIE-Layout-Pytorch

An unofficial Pytorch implementation of ERNIE-Layout which is originally released through PaddleNLP.

vrdu

We identify the desiderata for a comprehensive benchmark and propose Visually Rich Document Understanding (VRDU). VRDU contains two datasets that represent several challenges: rich schema including diverse data types, complex templates, and diversity of layouts within a single document type.

MegaParse

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

SPIN

The official implementation of Self-Play Fine-Tuning (SPIN)

CDLA

CDLA: A Chinese document layout analysis (CDLA) dataset

TableBank

TableBank: A Benchmark Dataset for Table Detection and Recognition

DocLayNet

DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysis

M6Doc

UPOCR

Official implementation of UPOCR: Towards unified pixel-level OCR interface (ICML 2024)

LATIN-Prompt

Noi

🚀 Power Your World with AI - Explore, Extend, Empower.

i-Code

ollama

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

llama.cpp

LLM inference in C/C++

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

MultimodalOCR

On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)

Vary

Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.

llama

Inference code for Llama models

MAP-NEO

OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (Support 70B+ full tuning & LoRA & Mixtral & KTO)

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

llama3-from-scratch

llama3 implementation one matrix multiplication at a time