osmr / imgclsmob

Sandbox for training deep learning networks

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Random initialization of untrained models

jessicaloke opened this issue · comments

Is it possible to set random seeds for the untrained models? How would I go about doing so?

Since the initialization of the network weights is a very sensitive thing for quality learning, initialization for all frameworks, except PyTorch, is your area of responsibility. Accordingly, depending on the framework, this is done in different ways.

I'm doing this in PyTorch - how would I do so then?

Then weights are already randomly initialized. If you are interested in learning reproducibility, then pay attention to the function torch.manual_seed().

I see; I had use this function but i had thought that there could be a different way of initializing models.
Thank you for the quick response! (: