OpenNMT / CTranslate2

Fast inference engine for Transformer models

Home Page:https://opennmt.net/CTranslate2

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

OpenVino GPU plugin support

hlevring opened this issue · comments

It would be great with better GPU supports for non discrete GPU's . One idea would be to support OpenVino GPU plugin

Ok , so I just realized that CTranslate2 has some support for oneDNN already (CPU only) , so oneDNN which also aims to support both Intel and AMD GPU's would probably be the way to go with any efforts to support mode backends. But as mentioned here #1072 , this would still require some significant work.

Should have done a bit more research before opening this ticket in the first place. Closing it.