chenxn2020

dude

DUDE: Document UnderstanDing of Everything Benchmark

kleister-charity

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

docile

DocILE: Document Information Localization and Extraction Benchmark

Cheetah

chatgpt

ChatGPT 从入门到精通

LLMsNineStoryDemonTower

【LLMs九层妖塔】分享 LLMs在自然语言处理（ChatGLM、Chinese-LLaMA-Alpaca、小羊驼 Vicuna、LLaMA、GPT4ALL等）、信息检索（langchain）、语言合成、语言识别、多模态等领域（Stable Diffusion、MiniGPT-4、VisualGLM-6B、Ziya-Visual等）等 实战与经验。

LLaVAR

Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"

MultiInstruct

MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning

AlignLLMHumanSurvey

Aligning Large Language Models with Human: A Survey

LLMAgentPapers

Must-read Papers on LLM Agents.

codeinterpreter-api

👾 Open source implementation of the ChatGPT Code Interpreter

hiertext

The HierText dataset contains ~12k images from the Open Images dataset v6 with large amount of text entities. We provide word, line and paragraph level annotations.

WebCPM

Official codes for ACL 2023 paper "WebCPM: Interactive Web Search for Chinese Long-form Question Answering"

LRV-Instruction

[ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning

BMTools

Tool Learning for Big Models, Open-Source Solutions of ChatGPT-Plugins

X-Decoder

[CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language

ToolLearningPapers

Labal-Anything-Pipeline

Baby-DALL3: Annotation anything in visual tasks and Generate anything just all in one-pipeline with GPT-4 (a small baby of DALL·E 3).

KnowledgeVL-Reading

WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

mPLUG-DocOwl

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

Multi-Modality-Arena

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!

Awesome-LLM-KG

Awesome papers about unifying LLMs and KGs

awesome-instruction-dataset

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

langflow

⛓️ Langflow is a visual framework for building multi-agent and RAG applications. It's open-source, Python-powered, fully customizable, model and vector store agnostic.

xlang-paper-reading

Paper collection on building and evaluating language model agents via executable language grounding

flaxformer

t5x

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.