Lightning-AI / pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

Home Page:https://lightning.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Add truncated backpropagation through time (TBPTT) example

svnv-svsv-jm opened this issue · comments

📚 Documentation

It seems like there is not example anymore about how to deal with Truncated Backpropagation Through Time in the latest versions. Am I wrong?

cc @Borda

Special support for TBPTT was removed in Lightning 2.0. The release notes here provide an example how you could implement it normally, see the section Truncated backpropagation through time (TBPTT).

Adding a TBTT example to the docs would be possible too. Contributions towards this would be welcomed.