KhaledSharif/TsetlinMachine

Tsetlin Machine implementation in Rust

A "Tsetlin Machine" solves complex pattern recognition problems with easy-to-interpret propositional formulas, and is composed of a collective of Tsetlin Automata. The idea of the machine was proposed in a paper by Ole-Christoffer Granmo.

Running the XOR test

Clone this repository using git clone https://github.com/KhaledSharif/TsetlinMachine.git
Inside the repository root folder, run cargo test
The test will run the XOR example found in tests/xor.rs
The test will only pass if the Tsetlin Machine reaches an accuracy greater than 99% on XOR

Training and testing on MNIST

Get the MNIST data from Kaggle in CSV form
Create a folder called mnist in the same folder that contains src and tests
Copy train.csv and test.csv into the newly created mnist folder
Run cargo run from the repository root folder
Read the code inside src/main.rs to get a better understanding

Example XOR code

let mut tm = tsetlin_machine();
tm.create(2, 2, 10);

let mut rng = thread_rng();
let mut average_error : f32 = 1.0;

for e in 0..1000
{
    let input_vector = &inputs[e % 4];
    {
        let output_vector = tm.activate(input_vector.to_vec());
        let mut correct = false;
        if (input_vector[0] == input_vector[1]) && (!output_vector[0] && output_vector[1])
        {
            correct = true;
        }
        else if output_vector[0] && !output_vector[1]
        {
            correct = true;
        }
        average_error = 0.99 * average_error + 0.01 * (if !correct {1.0} else {0.0});
        println!("{} {} -> {} {} | {}", input_vector[0], input_vector[1], output_vector[0], output_vector[1], average_error);
    }
    tm.learn(&outputs[e % 4], 4.0, 4.0, &mut rng);
}

Example XOR output

true true -> false true   | 0.00007643679
false false -> false true | 0.00007567242
false true -> true false  | 0.0000749157
true false -> true false  | 0.00007416654
true true -> false true   | 0.000073424875

Original implementation

This repository is a translation of this repository, which is an implementation of the Tsetlin Machine in C++.

KhaledSharif / TsetlinMachine