tdye24

llm-inference-benchmark

LLM Inference benchmark

LLMs_interview_notes

LLMs interview notes and answers:该仓库主要记录大模型（LLMs）算法工程师相关的面试题和参考答案

Personalized_PCA

An implementation for personalized PCA

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

llama3

The official Meta Llama 3 GitHub site

Awesome-LLM-Compression

Awesome LLM compression research papers and tools.

dap-cl

Official code of "Generating Instance-level Prompts for Rehearsal-free Continual Learning (ICCV 2023)"

LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

llm-action

本项目旨在分享大模型相关技术原理以及实战经验。

Monkey

【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models

Bolaco

idl_data

OCR Annotations from Amazon Textract for Industry Documents Library

MM-NIAH

This is the official implementation of the paper "Needle In A Multimodal Haystack"

GAOKAO-Bench

GAOKAO-Bench is an evaluation framework that utilizes GAOKAO questions as a dataset to evaluate large language models.

CogVLM2

GPT4V-level open-source multi-modal model based on Llama3-8B

CHIP2022_MedTable-MedInvoice_CogVLM

阿里天池算法竞赛-CHIP2022医疗清单发票OCR要素提取任务-solution

DuReader

Baseline Systems of DuReader Dataset

ChiQA

The implementations of various baselines in our CIKM 2022 paper: ChiQA: A Large Scale Image-based Real-World Question Answering Dataset for Multi-Modal Understanding.

Efficient-Multimodal-LLMs-Survey

Efficient Multimodal Large Language Models: A Survey

TaiSu

TaiSu（太素）--a large-scale Chinese multimodal dataset（亿级大规模中文视觉语言预训练数据集）

CLUEDatasetSearch

搜索所有中文NLP数据集，附常用英文NLP数据集

screen_qa

ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K question-answer pairs collected by human annotators for ~35K screenshots from Rico. It should be used to train and evaluate models capable of screen content understanding via question answering.

MP-DocVQA-Framework

ChartQA

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

FedPR

【CVPR 2023】Learning Federated Visual Prompt in Null Space for MRI Reconstruction

VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 30+ benchmarks

invoice

Collaboration with wangxupeng(https://github.com/wangxupeng)