attention maps generated in pre-training stage or fine-turning stage
Shicheng-Guo opened this issue · comments
Shicheng Guo commented
Dear Jerry,
Thank you so much for the great contribution to the filed to develop this awesome pretraining model. The manuscript doesn't explicitly mention whether the attention maps (DNABERT-viz) are generated during the pretraining stage or the fine-tuning stage. Could you please more some explicitly explanation.
Thanks.
Shicheng