Will memorization experimental codes be released?

[Chujie Zheng]

Thanks for your great work in analyzing the memorization phenomenon of language models (https://arxiv.org/abs/2304.11158). Will the codes be released for replication?

[Hailey Schoelkopf]

Our code, written by @uSaiPrashanth for that paper, should largely be kept at https://github.com/EleutherAI/gpt-neox/tree/memorization !

We'll be writing up documentation for this code at some point, though it won't be ready right away because Sai is quite busy right now. If you have any questions, I can attempt to answer them as needed as well!

[Stella Biderman]

See also #99