Request for documentation: the relationship between "Swing Army Transformer" and Nvidia's "FasterTransformer"
Oukaishen opened this issue · comments
Sorry if this is covered somewhere; I looked through the docs and issues and couldn't find it.
My request is: can you explain in the docs if FasterTransformer and Swing Army Transformer compete (or am I mistaken and both can be used), and if so, when to pick one or the other?
Thank you!
No, they are for different purposes. SAT is for fast develop (model design) and training, while FasterTransformer is for inference.