vgel / repeng

A library for making RepE control vectors

Home Page:https://vgel.me/posts/representation-engineering/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Base model and vector merging

whitepapercg opened this issue · comments

Hi, can you suggest how to merge the base model and the trained vector?

Hmm, not sure if it's possible since the library wraps extra code around the model to add the vector. Maybe by adding the vector to the appropriate layer bias? But it might be architecture-dependant based on normalization... I've been thinking about this as well so open to suggestions here!