[Question] How to update the gradient of vit?

[Lin Tianwei]

Question

When I set vit's attribute requires_grad to True, when loss performs gradient backpass, vit's grad is still None. I think this is because the function truncates the gradient postback when organizing text and images as input. Can someone tell me how to update the gradient of vit? Thank you!