Cannot use torch.compile with SAT
lijing1996 opened this issue · comments
Jing Li commented
I tried to use torch.compile but failed with SAT. The reason is that self.transformer.hooks.clear() in base_model.py also clear the hooks of torch.compile?
SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
lijing1996 opened this issue · comments
I tried to use torch.compile but failed with SAT. The reason is that self.transformer.hooks.clear() in base_model.py also clear the hooks of torch.compile?