rain305f

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

AniPortrait

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

pytorch-fid

Compute FID scores with PyTorch.

reflexion

[NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning

Awesome-Federated-Machine-Learning

Everything about federated learning, including research papers, books, codes, tutorials, videos and beyond

MagicTime

MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators

conditional-flow-matching

TorchCFM: a Conditional Flow Matching library

FaceFormer

[CVPR 2022] FaceFormer: Speech-Driven 3D Facial Animation with Transformers

RectifiedFlow

Official Implementation of Rectified Flow (ICLR2023 Spotlight)

Anti-DreamBooth

Anti-DreamBooth: Protecting users from personalized text-to-image synthesis (ICCV 2023)

common_metrics_on_video_quality

You can easily calculate FVD, PSNR, SSIM, LPIPS for evaluating the quality of generated or predicted videos.

MMA-Diffusion

[CVPR2024] MMA-Diffusion: MultiModal Attack on Diffusion Models

text2image_safety

Awesome-MLLM-Safety

Accepted by IJCAI-24 Survey Track

Open-Sora-Dataset

Duolando

Code for ICLR 2024 paper "Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment"

Uniaa

Unified Multi-modal IAA Baseline and Benchmark

curiosity_redteam

Official implementation of ICLR'24 paper, "Curiosity-driven Red Teaming for Large Language Models" (https://openreview.net/pdf?id=4KqkizXgXU)

FineR

[ICLR'24] Democratizing Fine-grained Visual Recognition with Large Language Models

Awesome-T2I-safety-Papers

List of T2I safety papers, updated daily, welcome to discuss using Discussions

AdaShield

[ECCV 2024] The official code for "AdaShield: Safeguarding Multimodal Large Language Models from Structure-based Attack via Adaptive Shield Prompting."

Universal-Prompt-Injection

The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".

JailBreakV_28K

JailBreakV-28K: A comprehensive benchmark designed to evaluate the transferability of LLM jailbreak attacks to MLLMs, and further assess the robustness and safety of MLLMs against a variety of jailbreak attacks.

unsafe-diffusion

ActiveGCD

Code for our CVPR 2024 paper "Active Generalized Category Discovery"

RIATIG

TextGrad

Multimodal-Roadmap-for-freshman

本项目用于Multimodal领域新手的学习路线，包括该领域的经典论文，项目及课程。旨在希望学习者在一定的时间内达到对这个领域有较为深刻的认知，能够自己进行的独立研究。

FedoSSL

code for paper "Towards Unbiased Training in Federated Open-world Semi-supervised Learning"

Divide-and-Conquer-Attack

Divide-and-Conquer Attack: Harnessing the Power of LLM to Bypass the Censorship of Text-to-Image Generation Mode