Mortyzhou-Shef-BIT

CVPR2024-Papers-with-Code

CVPR 2024 论文和开源项目合集

VoiceCraft

Zero-Shot Speech Editing and Text-to-Speech in the Wild

ProPainter

[ICCV 2023] ProPainter: Improving Propagation and Transformer for Video Inpainting

swift

ms-swift: Use PEFT or Full-parameter to finetune 300+ LLMs or 50+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3, Llava-Video, Internvl2, MiniCPM-V, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)

FeatUp

Official code for "FeatUp: A Model-Agnostic Frameworkfor Features at Any Resolution" ICLR 2024

ISAT_with_segment_anything

Labeling tool with SAM(segment anything model),supports SAM, sam-hq, MobileSAM EdgeSAM etc.交互式半自动图像标注工具

ODISE

Official PyTorch implementation of ODISE: Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models [CVPR 2023 Highlight]

ovsam

[arXiv preprint] The official code of paper "Open-Vocabulary SAM".

VideoMamba

[ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding

multimodal-prompt-learning

[CVPR 2023] Official repository of paper titled "MaPLe: Multi-modal Prompt Learning".

speech-trident

Awesome speech/audio LLMs, representation learning, and codec models

soft-vc

Soft speech units for voice conversion

ltu

Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".

VisionMamba

Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model" It's 2.8x faster than DeiT and saves 86.8% GPU memory when performing batch inference to extract features on high-res images

BARTScore

BARTScore: Evaluating Generated Text as Text Generation

Awesome-Human-Activity-Recognition

An up-to-date & curated list of Awesome IMU-based Human Activity Recognition(Ubiquitous Computing) papers, methods & resources. Please note that most of the collections of researches are mainly based on IMU data.

PromptSRC

[ICCV'23 Main Track, WECIA'23 Oral] Official repository of paper titled "Self-regulating Prompts: Foundational Model Adaptation without Forgetting".

awesome-self-supervised-multimodal-learning

[T-PAMI] A curated list of self-supervised multimodal learning resources.

ViP-LLaVA

[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts

MMStar

This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

Recent-Image-Quality-Related-Papers

A list of image quality related papers published in top conferences and journals

SPMamba

class-incremental-learning

PyTorch implementation of a VAE-based generative classifier, as well as other class-incremental learning methods that do not store data (DGR, BI-R, EWC, SI, CWR, CWR+, AR1, the "labels trick", SLDA).

PEL4VAD

Official code for "Learning Prompt-Enhanced Context features for Weakly-Supervised Video Anomlay Detection"

HammerLLM

1.4B sLLM for Chinese and English - HammerLLM🔨

Multimodal-Learning-with-Alternating-Unimodal-Adaptation

Multimodal Learning Method MLA for CVPR 2024

ICLR2024-REDL

[ICLR 2024 Spotlight] R-EDL: Relaxing Nonessential Settings of Evidential Deep Learning

JoMoLD

[ECCV 2022] Joint-Modal Label Denoising for Weakly-Supervised Audio-Visual Video Parsing

ACES

Audio Captioning Evaluation on Semantics of Sound (ACES)

r2bench

[ECCV 2024] R2-Bench: Benchmarking the Robustness of Referring Perception Models under Perturbations