could I utilize this work on other datasets?

[jessie]

hi thanks for your great work.

i am working on brain tumor segmentation, could i use this model and its ckpt to generate a useful text from brain image(like image captioning, but in medical domain)?

[Aaron Nicolson]

Hi Jessie,

To get a model such as this to do what you want, you would have to perform fine-tuning/transfer learning with a dataset of the target task.

A.

[Chung Him KWOK]

Hi, I am working on an ARRG project and would attempt to finetune your model on a custom dataset. Is it possible for you to include guidelines or instructions on how to finetune your model on other datasets? In particular, is there any special config that we have to modify? Thanks a lot!

[Aaron Nicolson]

Hi, you would need to make a custom https://pytorch.org/docs/stable/data.html#torch.utils.data.Dataset. Then modify the lightning module to feed the torch dataset to the dataloaders. The torch datasets are initialised in the lightning modules setup definition. Look in the config directory for the config files.

Hope this helps,
A.