When using Import Transformer_engine, many processes will be created
zte-tcb opened this issue · comments
tangchb commented
When I only import transformer_engine, it will create many processes. I found that this was pre created many compilation processes when using torch.compile. I want to know if these processes can stop after the first round of training.
TransformerEngine:1.4
torch: 2.1.0