chenxn2020

SimChart9K

The proposed simulated dataset consisting of 9,536 charts and associated data annotations in CSV format.

MMC

[NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning

ChartFC_chartBERT

Data and Code for EACL 2023 Paper "Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking"

ChartLlama-code

Qwen

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

dessurt

Official implementation for Dessurt

ocr-dataset-rendering

Monkey

【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models

codellama

Inference code for CodeLlama models

layout-dm

LayoutDM: Discrete Diffusion Model for Controllable Layout Generation [Inoue+, CVPR2023]

ComVint

The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Instruction Tuning''

Qwen-VL

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

LayoutNUWA

DiffUTE

This repository is the code of our paper "DiffUTE: Universal Text Editing Diffusion Model" (NeurIPS'2023).

knowledge-rumination

[EMNLP 2023] Knowledge Rumination for Pre-trained Language Models

tagme-python

Official TagMe API wrapper for Python.

awesome-detection-transformer

Collect some papers about transformer for detection and segmentation. Awesome Detection Transformer for Computer Vision (CV)

Awesome-LLM-hallucination

LLM hallucination paper list

detrex

detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.

DINO

[ICLR 2023] Official implementation of the paper "DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection"

HRDoc

Dataset and scripts for HRDoc

DocParser

DSG

texannotate

TeX compilation service that makes use of arXiv.org's AutoTeX library.

AdvancedLiterateMachinery

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

LM4VisualEncoding

[ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"

pyecharts

🎨 Python Echarts Plotting Library

HallusionBench

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

UReader

ChartQA