Will this repo add the reformer or teach people how to implement reformer in Pytorch?
JonathanSum opened this issue · comments
I think this repo should add reformer and teach how to implement and use it for people.
@JonathanSum Here is the latest and the greatest AFAIK :)
huggingface transformers repo has Reformer colab/support as well.
It would be really cool if @karpathy Andrew made a similar implementation for a Reformer or other latest SOTA transformer. He did a fantastic job with minGPT. AFAIK minGPT is the best open-source implementation of GPT2. I have not seen better yet...
@asigalov61 Thank you for sharing.
Maybe I have asked too much, and I think it is time to close this.