finetunej / misc

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

misc

SizeTest: Open In Colab

gpt-neo to gpt2

This script allows converting a transformers gpt-neo model into a gpt2 model. Local attention is implemented through the bias buffer and stored in the weights.

About


Languages

Language:Jupyter Notebook 92.4%Language:Python 7.6%