tlkh / t5-fp16-surgery

T5 FP16 Surgery

t5-fp16-surgery

T5 FP16 Surgery - converting existing T5 models to work with FP16 training

Converted Models

Feel free to play with the models and fine-tune them and see if they work for you (with FP16!)

• https://huggingface.co/tlkh/t5_3B_fp16_untuned
• https://huggingface.co/tlkh/tlkh/t5_large_fp16_untuned

Converting Models

See the notebooks in the repo for reference.