hyperdrive / EvoNet

Evolve random projection based neural networks.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

EvoNet

Evolve random projection based neural networks. The output of a linear random projection (RP) usually has a Gaussian distribution. The product of 2 (or more) such RP's has a spiky non-Gaussian distribution. A vector of such products is point-wise sparse, taking a further RP creates a pattern-wise sparse vector. This is probably a better form to multiply by weights for a neural network. Alternatively you can take the element wise square of one vector of random projections as a point-wise sparse vector, and then convert that to the (higher entropy) pattern wise sparse vector.

More information: https://randomprojectionai.blogspot.com/

About

Evolve random projection based neural networks.


Languages

Language:Visual Basic 65.8%Language:JavaScript 20.4%Language:Java 12.9%Language:Processing 0.9%