fast-weight-programmers

There are 0 repository under fast-weight-programmers topic.

IDSIA / modern-srwm
Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep RL Workshop) and "Accelerating Neural Self-Improvement via Bootstrapping" (ICLR 2023 Workshop)
fast-weight-programmers fast-weights pytorch reinforcement-learning rnn-based-few-shot-learning self-referential-learning self-referential-weight-matrix torchbeast transformers
Language:Python 171
IDSIA / recurrent-fwp
Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
fast-weight-programmers fast-weights language-modeling pytorch recurrent-neural-networks reinforcement-learning torchbeast transformers
Language:Python 50
kazuki-irie / kv-memory-brain
Official Code Repository for the paper "Key-value memory in the brain"
fast-weight-programmers key-value-memory retrograde-amnesia transformers
Language:Jupyter Notebook 29
IDSIA / neuraldiffeq-fwp
Official repository for the paper "Neural Differential Equations for Learning to Program Neural Nets Through Continuous Learning Rules" (NeurIPS 2022)
controlled-differential-equations fast-weight-programmers fast-weights neural-differential-equations neural-odes continuous-time-sequence-processing
Language:Python 23
IDSIA / lmtool-fwp
PyTorch Language Modeling Toolkit for Fast Weight Programmers
fast-weight-programmers fast-weights language-model pytorch transformers
Language:Python 18
IDSIA / automated-cl
Official repository for the paper "Automating Continual Learning"
continual-learning cuda fast-weight-programmers fast-weights few-shot-learning linear-transformers meta-learning pytorch self-referential-learning self-referential-weight-matrix transformers
Language:Python 16
IDSIA / fpainter
Official repository for the paper "Images as Weight Matrices: Sequential Image Generation Through Synaptic Learning Rules" (ICLR 2023)
fast-weight-programmers fast-weights generative-adversarial-network image-generation neural-learning-rules transformers
Language:Python 12
kazuki-irie / hybrid-memory
Official repository for the paper "Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers"
attention fast-weight-programmers flame flash-linear-attention key-value-memory language-model pytorch reinforcement-learning transformers
Language:Python 12
IDSIA / fwp-formal-lang
Official repository for the paper "Practical Computational Power of Linear Transformers and Their Recurrent and Self-Referential Extensions" (EMNLP 2023)
fast-weight-programmers fast-weights formal-languages pytorch self-referential-learning linear-transformers self-referential-weight-matrix
Language:Cuda 5
kazuki-irie / dct-fast-weights
PyTorch implementation of DCT fast weight RNNs
dct fast-weight-programmers fast-weights language-modeling pytorch recurrent-neural-networks
Language:Python 5

fast-weight-programmers

IDSIA / modern-srwm

IDSIA / recurrent-fwp

kazuki-irie / kv-memory-brain

IDSIA / neuraldiffeq-fwp

IDSIA / lmtool-fwp

IDSIA / automated-cl

IDSIA / fpainter

kazuki-irie / hybrid-memory

IDSIA / fwp-formal-lang

kazuki-irie / dct-fast-weights