abacaj / compare_inference

dynamo inference

compare_inference

Compare speed of different inference methods

• kernl - compare_kernl.ipynb
• transformer-deploy - compare_transformer-deploy.ipynb

Since each inference repo needs its own dependency and is rapidly evolving, we submodule them under different sub-directories with separate dev container configs.