Too many threads created
kiriharulxh opened this issue · comments
Hi, thanks for the excellent work! I was trying to train a flan-t5-small model using the t5x code on gpu. But it turned out that the iteration of the mixture dataset for creating the first batch somehow created nearly 30000 threads and the program broke down, output exactly the same error as the problem mentioned here. I wonder if there's any problem with the way I use the t5x code and I'll appreciate it so much if there's any advice.
hello @kiriharulxh , did you eventually solve this issue, if so, how?