Giters

labmlai / annotated_deep_learning_paper_implementations

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

Home Page:https://nn.labml.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Wrong output of shift right example in the commnets?

harveyaot opened this issue · comments

commented

annotated_deep_learning_paper_implementations/labml_nn/transformers/xl/relative_mha.py

Line 28 in 9a42ac2

result would be `[[1, 2 ,3], [0, 4, 5], [9, 0, 7]]`.

this should be [[1, 2 ,3], [0, 4, 5], [6, 0, 7]]

commented

Thanks! Fixed f42c0e9