triton-inference-server / openvino_backend

OpenVINO backend for Triton.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support for arm64 mac m1 chips?

SamSamhuns opened this issue · comments

Hi, the readme states OpenVINO backend currently supports inference only on Intel CPU devices using [OpenVINO CPU plugin](https://docs.openvinotoolkit.org/latest/openvino_docs_IE_DG_supported_plugins_CPU.html). Does this mean when I am running the triton server, OpenVINO backend is not available for M1 chip macs?

And are there plans to support the m1 arm chips in the future?