Finetuning - freeze_trunk
joSilva99 opened this issue · comments
joSilva99 commented
Hi, please I need some help.
I'm trying to finetuning using the --freeze_trunk
tag.
But when I search in the code I can't find the usage of the tag.
You didn't implemented this functionality?
I can't find the place where you check if args.freeze_trunk
is true.
Can you give some tip?
Thanks
karansapra commented
hi,
Sorry, I think that is legacy code from our previous repo that we need to cleanup. You would need to manually insert torch.no_grad support for this. Our trunk is quite isolated so this should be rather easy if you just trying to freeze the trunk.