hpcaitech / EnergonAI

Large-scale model inference.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Does EnergonAI support accelerated inference for segmenting anything?

sanbuphy opened this issue · comments

commented

The inference speed of the H model for segmenting anything feels relatively slow. I believe there should be common optimization techniques for transformers. Are there any reference materials available EnergonAI on this topic? Thank you.