JonnieWayy

ollama

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

codellama

Inference code for CodeLlama models

latent-diffusion

High-Resolution Image Synthesis with Latent Diffusion Models

Track-Anything

Track-Anything is a flexible and interactive tool for video object tracking and segmentation, based on Segment Anything, XMem, and E2FGVI.

GroundingDINO

Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

mm-cot

Official implementation for "Multimodal Chain-of-Thought Reasoning in Language Models" (stay tuned and more will be updated)

Video-LLaMA

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

StableSR

Exploiting Diffusion Prior for Real-World Image Super-Resolution

VMamba

VMamba: Visual State Space Models，code is based on mamba

Video-ChatGPT

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

Awesome-diffusion-model-for-image-processing

one summary of diffusion-based image processing, including restoration, enhancement, coding, quality assessment

PickScore

MOSE-api

[ICCV 2023] MOSE: A New Dataset for Video Object Segmentation in Complex Scenes

ViT-Slim

Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”

KEPLER

Source code for TACL paper "KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation".

BeMapNet

ContextDET

Contextual Object Detection with Multimodal Large Language Models

StreamMapNet

bassl

REVERIE

REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environments

SUR-adapter

ACM MM'23 (oral), SUR-adapter for pre-trained diffusion models can acquire the powerful semantic understanding and reasoning capabilities from large language models to build a high-quality textual semantic representation for text-to-image generation.

ldcast

Latent diffusion for generative precipitation nowcasting

prompt2walk

Code for Prompt a Robot to Walk with Large Language Models https://arxiv.org/abs/2309.09969

EgoObjects

[ICCV2023] EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understanding

VidSTG-Dataset

This repository provides the dataset introduced by the paper "Where Does It Exist: Spatio-Temporal Video Grounding for Multi-Form Sentences"

HC-STVG

The HC-STVG Dataset

Precipitation-nowcasting-with-generative-diffusion-models

Code relative to the publication "Precipitation nowcasting with generative diffusion models"

TREK-150-toolkit

Official code repository to download the TREK-150 benchmark dataset and run experiments on it.