OpenNLPLab

AVSBench

[ECCV 2022] & [IJCV 2024] Official implementation of the paper: Audio-Visual Segmentation (with Semantics)

TransnormerLLM

Official implementation of TransNormerLLM: A Faster and Better LLM

lightning-attention

Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models

cosFormer

[ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention

FAVDBench

[CVPR 2023] Official implementation of the paper: Fine-grained Audible Video Description

Tnn

[ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling

LASP

Linear Attention Sequence Parallelism (LASP)

HGRN

[NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Sequence Modeling

Transnormer

[EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer

HGRN2

HGRN2: Gated Linear RNNs with State Expansion

FNAC_AVL

[CVPR 2023] Official implementation of our paper - Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learning

Vicinity-Vision-Transformer

[TPAMI 2023] This is an official implementation for "Vicinity Vision Transformer".

MMVAE-AVS

Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].

ETSC-Exact-Toeplitz-to-SSM-Conversion

[EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz Neural Network with Constant-time Inference Complexity

Lrpe

Linearized Relative Positional Encoding

ACR_WSSS

[ICCV 2023 Workshop] Official implementation of the paper: All-pairs Consistency Learning for Weakly Supervised Semantic Segmentation

CO2

CO2: Efficient Distributed Training with Full Communication-Computation Overlap

TAVGBench

Demo page of TAVGBench: Benchmarking Text to Audible-Video Generation

DiffusionAVS

Audio-visual segmentation with diffusion model

ScalingLaws

Scaling Laws for Linear Complexity Language Models

fairseq-evo

Fairseq with transformer evolution

mixFormer

This repo is the official implementations of "Neural Architecture Search on Efficient Transformers and Beyond".

AVS-bidirectional

audio-visual segmentation with bidirectional generation

lra

Linear_VideoTransformer

This repo is the official implementations of "Linear Video Transformer with Feature Fixation".

im

cosformer_website

vvt

Zoology

The fork version of the origin zoology.