microsoft / onnxruntime-genai

Generative AI extensions for onnxruntime

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Loading Image from bytes

msciancalepore98 opened this issue · comments

Hey, I am trying to integrate your phi-3-vision script into LitServe.

How can I use the already loaded image (bytes) and pass it to the processor? (I don't want to save it as local/tmp file)

Thanks

Hi sorry for the late response. We do not have support for loading an image from bytes at this point.

We can enhance the usage for the next release 0.4.0.