Abe404 / RootPainter3D

RootPainter3D: Interactive-machine-learning enables rapid and accurate contouring for radiotherapy

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Multiclass train/validation split is made repeatedly across each class

jenspete opened this issue · comments

The decision of whether to add images to the validation or training set is made when an annotation is saved. This however happens for each class and so images may be in the training set for one class and validation set for another class. The model could therefore potentially overfit to the validation set.

A simple fix could be to check if the file is already in the training or validation set for another class before choosing the set.

Good point. I'm working on another issue at the moment but I will try to get this addressed within the next 10 days. Let me know if you need it sooner.