vtsouval

differentiable-mel-spectrogram

The official implementation of DMEL the method presented in the paper "DMEL: The differentiable log-Mel spectrogram as a trainable layer in neural networks".

Task-Modeling

Modeling task relationships with surrogate modeling

ForkMerge

Code release of paper "ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning" (NeurIPS 2023)

FedFisher

Code for the paper "FedFisher: Leveraging Fisher Information for One-Shot Federated Learning" by Divyansh Jhunjhunwala, Shiqiang Wang, and Gauri Joshi, published in AISTATS 2024.

TaskTransferAnalysis

Analysis of Task Transferability in Large Pre-trained Classifiers.

ViT-Lens

[CVPR 2024] ViT-Lens: Towards Omni-modal Representations

ETran

[ICCV2023] ETran: Energy-based Transferability Estimation

pactran_metrics

sliced_opt

minLoRA

minLoRA: a minimal PyTorch library that allows you to apply LoRA to any PyTorch model.

task_vectors

Editing Models with Task Arithmetic

fed-multimodal

FedMultimodal

peft-ser

PEFT-SER: On the Use of Parameter Efficient Transfer Learning Approaches For Speech Emotion Recognition Using Pre-trained Speech Models (Accepted to 2023 ACII)

FedCompress

Communication-Efficient Federated Learning through Adaptive Weight Clustering and Server-Side Distillation

PETL_AST

This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters".

ViT-Adapter

[ICLR 2023 Spotlight] Vision Transformer Adapter for Dense Predictions

adapter-wavlm

Vim

Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

LKCA-MiniViTsTrainer-Pytorch-CIFAR-TinyImageNet

LKCA official repository

byol-a

BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation

PaSST

Efficient Training of Audio Transformers with Patchout

VMamba

VMamba: Visual State Space Models，code is based on mamba

CLAP

Contrastive Language-Audio Pretraining

AudioMAE

This repo hosts the code and models of "Masked Autoencoders that Listen".

M2PT

[CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities

MultiModalMamba

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

UnIVAL

[TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.

R-AMT

Image-Encryption-using-Chaotic-Synchronization

📖 ECPC23 - Analog Integrated Circuits Course Project

bias_in_FL

This is the code repository for the paper titled "Bias Propagation in Federated Learning" which was accepted to the International Conference on Learning Representations (ICLR) 2023.