MikhailKravets / NeuroFlow

Awesome deep learning crate

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

help with iteration argument

era127 opened this issue · comments

commented

Hi, I was wondering if you could explain the iterations argument and the solver. Is the iterations, the number of times the dataset is sampled with an individual row, or is iterations the number of pass through the whole data set? So if the dataset has 10_000 rows, iterations = 10_000 would imply the dataset would be sampled 10000 times with batchsize = 1 row?

From what I understood in the code, the rand() call in train() only selected one row per iteration.

Also I wanted to confirm that the error is cumulative for all iterations, especially if you call train() multiple times in a loop.

Thanks

Hi @rdavis120,

Yes, your understanding is correct. The training algorithm retrieves one random item per training iteration.

Regarding the error, it is zeroed during each backward step (see FeedForward::backward method). So, when you then call the get_error method, it returns the latest error of the network.

Let me know if you have further questions.