mahmozaffari

HieCoAttenVQA

vqaloader

PyTorch DataLoader for many VQA datasets

Book-Mathematical-Foundation-of-Reinforcement-Learning

This is the homepage of a new book entitled "Mathematical Foundations of Reinforcement Learning."

outlines

Structured Text Generation

aici

AICI: Prompts as (Wasm) Programs

evidential-deep-learning

Learn fast, scalable, and calibrated measures of uncertainty using neural networks!

Multifaceted-Uncertainty-Estimation-for-Label-Efficient-Deep-Learning

open_clip

An open source implementation of CLIP.

LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

UQ-PLM

Uncertainty Quantification with Pre-trained Language Models: An Empirical Analysis

exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

ColossalAI

Making large AI models cheaper, faster and more accessible

CVinW_Readings

A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

awesome-multimodal-in-medical-imaging

A collection of resources on applications of multi-modal learning in medical imaging.

ViP-LLaVA

[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts

CVTHead

[WACV 2024] "CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformer"

Retrieval-Augmented-Visual-Question-Answering

This is the official repository for Retrieval Augmented Visual Question Answering

PIRender

The source code of the ICCV2021 paper "PIRenderer: Controllable Portrait Image Generation via Semantic Neural Rendering"

two_tower_models

We write sample code for two tower models for retrieval and add RLHF/RLAIF style alignment with a ranking model to make the retrieval more aligned with the ranking model on top

deepface

A Lightweight Face Recognition and Facial Attribute Analysis (Age, Gender, Emotion and Race) Library for Python

facial-landmark-frontalization

Function to frontalize non-frontal 2D facial landmarks generated from the DLIB library

Talking-Face_PC-AVS

Code for Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation (CVPR 2021)

LAB

[CVPR 2018] Look at Boundary: A Boundary-Aware Face Alignment Algorithm

BLIP

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

Talking-head-Generation-with-Rhythmic-Head-Motion

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

PromptCap

natual language guided image captioning

REVIVE

[NeurIPS 2022] Official Code for REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering