Giters

Fsoft-AIC / Elliptical-Attention

[NeurIPS 2024] Elliptical Attention

Repository from Github https://github.comFsoft-AIC/Elliptical-AttentionRepository from Github https://github.comFsoft-AIC/Elliptical-Attention

attentionnon-parametric-kernel-regressionrepresentation-collapserobustnesstransformers

Elliptical Attention NeurIPS 2024 Code Implementation

See individual repos corresponding to sets of experiments for implementation

About

[NeurIPS 2024] Elliptical Attention

attentionnon-parametric-kernel-regressionrepresentation-collapserobustnesstransformers

Languages

Language:Python 93.2%Language:Cuda 2.9%Language:Shell 2.7%Language:C++ 1.2%Language:Dockerfile 0.0%