moskomule / memory_efficient_attention.pytorch

A human-readable PyTorch implementation of "Self-attention Does Not Need O(n^2) Memory" (Rabe&Staats'21).

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

moskomule/memory_efficient_attention.pytorch Stargazers