Running codes on Windows issues

[gerardaristizabalpla4]

Thanks so much Andrej for making these incredible videos!!!!

Could you please make them google collab friendly? I'm getting RuntimeErrors in the fineweb.py code and compile won't work for Windows because Triton can't be installed in Windows.

Thanks so much!!

[Dustin Loring]

Use the fineweb.py from this #4

[gerardaristizabalpla4]

Thanks! Yes, I already did that :) Also, scaled_dot_product_attention won't work because Triton can't be installed in Windows.