lcy0604

MegaHan97K

MegaHan97K: A Large-Scale Dataset for Mega-Category Chinese Character Recognition with over 97K Categories

anole

Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation

OpenDiT

OpenDiT: An Easy, Fast and Memory-Efficient System for DiT Training and Inference

synthtiger

Official Implementation of SynthTIGER (Synthetic Text Image Generator), ICDAR 2021

One-DM

Official implementation of One-DM (ECCV 2024).

Document-AI-Recommendations

Algorithms, papers, datasets, performance comparisons for Document AI. Continuously updating.

groundingLMM

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

LLaMA2-Accessory

An Open-source Toolkit for LLM Development

VisionLLM

VisionLLM Series

DiffMatch

Official implementation of "Diffusion Model for Dense Matching" (ICLR'24 Oral)

DocRes

[CVPR 2024] DocRes: A Generalist Model Toward Unifying Document Image Restoration Tasks

RFUND

Official release of RFUND introduced in the paper "PEneo: Unifying Line Extraction, Line Grouping, and Entity Linking for End-to-end Document Pair Extraction" (arXiv:2401.03472).

UPOCR

Official implementation of UPOCR: Towards unified pixel-level OCR interface (ICML 2024)

geektime-books

:books: 极客时间电子书

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Awesome-LLMs-Datasets

Summarize existing representative LLMs text datasets.

LWM

ChartAst

ChartAssistant is a chart-based vision-language model for universal chart comprehension and reasoning.

imagen-pytorch

Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

FontDiffuser

[AAAI2024] FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learning

EEG-Transformer

i. A practical application of Transformer (ViT) on 2-D physiological signal (EEG) classification tasks. Also could be tried with EMG, EOG, ECG, etc. ii. Including the attention of spatial dimension (channel attention) and *temporal dimension*. iii. Common spatial pattern (CSP), an efficient feature enhancement method, realized with Python.

UReader

T-Rex

[ECCV2024] API code for T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergy

LLM-in-Vision

Recent LLM-based CV and related works. Welcome to comment/contribute!

awesome_LLMs_interview_notes

LLMs interview notes and answers:该仓库主要记录大模型（LLMs）算法工程师相关的面试题和参考答案

GPT-4V_OCR

Evaluation of the Optical Character Recognition (OCR) capabilities of GPT-4V(ision)

LLM-Agent-Paper-List

The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.

OWTTT

[ICCV 2023 Oral] Official repository for “On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansion”

Text2Tex

[ICCV 2023] Text2Tex: Text-driven Texture Synthesis via Diffusion Models