dnap512

matmulfreellm

Implementation for MatMul-free LM.

MemVP

[ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning

Efficient-Multimodal-LLMs-Survey

Efficient Multimodal Large Language Models: A Survey

ChartReader

[ICCV 2023] ChartReader: A Unified Framework for Chart Derendering and Comprehension without Heuristic Rules

DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

rdnet

tablevqabench

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4V. 接近GPT-4V表现的可商用开源多模态对话模型

MM-Interleaved

MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer

Bard-API

The unofficial python package that returns response of Google Bard through cookie value.

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

scob

Official Implementation of SCOB [ICCV 2023]

S-LoRA

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

meru

Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023

AINDNet

Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalization (CVPR 2020)

cream

Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language Models, EMNLP 2023

CLEval

CLEval: Character-Level Evaluation for Text Detection and Recognition Tasks

ESTextSpotter

(ICCV 2023) ESTextSpotter: Towards Better Scene Text Spotting with Explicit Synergy in Transformer

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

units

LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

Awesome-CLIP

Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).

KELIP

Official PyTorch implementation of "Large-scale Bilingual Language-Image Contrastive Learning" (ICLRW 2022)

open_clip

An open source implementation of CLIP.

dessurt

Official implementation for Dessurt

ChartQA

datacomp

DataComp: In search of the next generation of multimodal datasets

mPLUG-Owl

mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

dinov2

PyTorch code and models for the DINOv2 self-supervised learning method.