pointlander / directFeedbackAlignment

Simple code to compare dfa and backprop on the xor task

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

##Documentation

Simple code to demonstrate Direct Feedback Alignment training of neural networks. Network with 2 hidden layers is trained to perform the xor computation. Same weight initializations trained using both DFA and Backpropagation for comparison.

DFA algorithm is implemented as described in this paper.

dfa.m will run and plot all results

##Figures

Sample training

Alt text

Average Convergence

Alt text

##References

Nøkland, Arild. "Direct Feedback Alignment Provides Learning in Deep Neural Networks." arXiv preprint arXiv:1609.01596 (2016).

About

Simple code to compare dfa and backprop on the xor task


Languages

Language:MATLAB 96.8%Language:Python 3.2%