Traditionally Neural Networks, even though considered as the peak of our AI achievements, lack the credibility of counting. For this very purpose Google's Deep Mind released paper - Neural Arithmetic Logical Units. An NALU is a combination of two Neural Accumulators (NACs) with a sigmoidal gate. The NAC is inherently good in accumulation process, example addition subtraction. The NALU, as name suggests, is an arithmetic and Logical unit. So it can perform any computable operations (even counting).
Structure of NAC and NALU |