Is there a way to freeze some layers of a model ?
shamanez opened this issue · comments
Can we follow the normal way of:
for param in model.base_model.parameters():
param.requires_grad = False
huggingface / alignment-handbook
Robust recipes to align language models with human and AI preferences