qubvel / segmentation_models

Segmentation models with pretrained backbones. Keras and TensorFlow Keras.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

massive datasets loading and training

davidvct opened this issue · comments

if I have a massive datasets of images, and unable to fit all of them into memory, how do I load and train them by batches?
my folder structure is:

datasets
|
|----Train
| |---- images
| |-----masks
|
|---- Val
|---- images
|---- masks