Giters

microsoft / onnxruntime-genai

Generative AI extensions for onnxruntime

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Looking for onnx version of microsoft/Phi-3-vision-128k-instruct

AshD opened this issue · comments

commented

Looking for onnx version of microsoft/Phi-3-vision-128k-instruct
Onnx files don't seem to be on Hugging Face.

Also, Does the onnxruntime-genai support multiple GPUs on the same PC?

Thanks,
Ash

commented

Looking for onnx version of microsoft/Phi-3-vision-128k-instruct
Onnx files don't seem to be on Hugging Face.

We intend to publish the onnx variant of the Phi3-Vision model in the next couple of days. We also intend to release the 0.3.0-rc2 onnxruntime-genai package in the same time frame that can run this model.

Also, Does the onnxruntime-genai support multiple GPUs on the same PC?

As of now, the onnxruntime-genai can only execute models on a single GPU. Executing models on multiple GPUs is a feature we plan to add in the future.

commented

Do you have the paper published about the architecture and details of Phi3-Vision model?

commented

The Phi-3 Technical Report should have details on the model architecture.

commented

The onnx version of the vision model has been published. Please refer to this tutorial on getting started: https://onnxruntime.ai/docs/genai/tutorials/phi3-v.html.

Closing this issue now. Please open another issue if you have further questions.