Training Code for T0*?

[Justin Reppert]

I'm trying to understand what it would take to reproduce some of the fine-tuning results in the paper -- I see the checkpoint (pytorch) weights are on HF hub, but is the training code publicly available anywhere?

Thanks!

[Victor SANH]

Hi @reppertj
Our training and evaluation codebase is mainly based on the t5 codebase (https://github.com/google-research/text-to-text-transfer-transformer). We then converted the trained checkpoints to pt to release them on the hub. I am happy to provide the tf checkpoints too if that's helpful.

[Justin Reppert]

Thanks, @VictorSanh! Yes, the TF checkpoints would absolutely be helpful.

[Victor SANH]

DMing you @reppertj

[Justin Reppert]

Thanks, @VictorSanh! Closing this issue.