berndporr / ICO-learning

Porr, B. and Wörgötter, F. (2006) Strongly Improved Stability and Faster Convergence of Temporal Sequence Learning by Using Input Correlations Only

Home Page:https://direct.mit.edu/neco/article/18/6/1380/7111/Strongly-Improved-Stability-and-Faster-Convergence

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ICO learning

DOI

alt tag

Porr, B. and Wörgötter, F. (2006) Strongly Improved Stability and Faster Convergence of Temporal Sequence Learning by Using Input Correlations Only

ICO learning is a learning algorithm which is inspired by spike timing dependent plasticity. It does "reflex avoidance": It replaces a slow feedback loop by a faster proactive action.

What do I need?

  • A C++ compiler
  • cmake
  • gnuplot (for plotting the demo data)

Installation

Linux / Mac

This installs libicolearning and the header files in the default install directories:

cmake .
make
sudo make install

Windows

cmake -G "Visual Studio 17 2022"

Then open icolearning.sln and click on "Build".

Demo

To get a feeling what ICO learning does there is a demo application (commandline / terminal). There are 3 different demo options.

Single filter and single weight in the predictive path

./demo 0
gnuplot onef_weights.plt

alt tag

Above shown are the weights of ICO learning. Until step 100000 there's a typical timing situation: First the predictive neuron is triggered and then the reflex neuron receives an input signal. The weights grow. Then it is assumed that the output of the neuron has successfully eliminated the reflex and therefore the reflex input stays zero (=error at zero). You see that the weights stabilise.

Spike timing dependent plasticity curve

The derivative of the reflex (or error input) correlated with the predictive input produces an Spike Timing Dependent (STDP) like weight change when the timing between predictive input and reflex is systematically changed.

./demo 1
gnuplot stdp.plt

alt tag

Filterbank with 10 different filters in the predictive pathway

The filterbank generates different timings so that the predictive pathway can choose the filter response which is best suited to eliminate the reflex.

./demo 10
gnuplot ten_filters_weights.plt

alt tag

Have fun!

About

Porr, B. and Wörgötter, F. (2006) Strongly Improved Stability and Faster Convergence of Temporal Sequence Learning by Using Input Correlations Only

https://direct.mit.edu/neco/article/18/6/1380/7111/Strongly-Improved-Stability-and-Faster-Convergence

License:GNU General Public License v3.0


Languages

Language:C++ 92.3%Language:CMake 4.7%Language:Gnuplot 3.0%