piyush2896 / NeuralALU

TensorFlow Implementation of Neural Arithmetic Logical Unit

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Neural Arithmetic Logical Units

Traditionally Neural Networks, even though considered as the peak of our AI achievements, lack the credibility of counting. For this very purpose Google's Deep Mind released paper - Neural Arithmetic Logical Units. An NALU is a combination of two Neural Accumulators (NACs) with a sigmoidal gate. The NAC is inherently good in accumulation process, example addition subtraction. The NALU, as name suggests, is an arithmetic and Logical unit. So it can perform any computable operations (even counting).

Structure of NALU

NALU and NAC
Structure of NAC and NALU

About

TensorFlow Implementation of Neural Arithmetic Logical Unit

License:MIT License


Languages

Language:Jupyter Notebook 80.7%Language:Python 19.3%