Giters
microsoft
/
onnxruntime-genai
Generative AI extensions for onnxruntime
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
350
Watchers:
44
Issues:
169
Forks:
80
microsoft/onnxruntime-genai Issues
Memory leak during back-to-back inferences
Updated
7 days ago
Comments count
11
CSharp examples crash on attempt to load model in Cuda mode (Release or Debug)
Updated
7 days ago
Warn users if image processor is not available
Updated
7 days ago
[Documentation] Not able to Install phi3-vision
Closed
17 days ago
Comments count
6
Inference with batching is significantly slower than without batching.
Updated
9 days ago
`models/builder.py` creates empty output directory
Closed
9 days ago
Comments count
7
try to build model gemma2 ,but failed.
Updated
9 days ago
Comments count
9
[Documentation] phi-3 vision tutorial lacks samples for languages that are actually used for desktop development.
Closed
9 days ago
Comments count
3
Nodes are not topologically sorted from models generated by model builder
Updated
9 days ago
Comments count
2
Add ARM64 support.
Closed
17 days ago
Comments count
2
An error occurred: Number of unique image tags does not match the number of images in WebAPI by ProcessImages(prompt, images);
Updated
10 days ago
Comments count
2
Help needed to export Phi3v in ONNX
Closed
12 days ago
Comments count
4
Raspberry Pi OS can not install onnxruntime-genai
Closed
12 days ago
Comments count
5
Post the strength compare with other deploy tools
Updated
13 days ago
Consider removing direct link-time dependency on ORT on Linux/macOS
Updated
13 days ago
Comments count
2
Fail to build win64 onnxruntime-genai-directml from source
Closed
13 days ago
Comments count
6
Library affecting other onnx runtimes
Closed
13 days ago
Comments count
2
ImportError: libcudnn.so.8: cannot open shared object file: No such file or directory
Closed
13 days ago
Comments count
4
Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException with Phi-3
Closed
15 days ago
Comments count
4
model loading progress callback
Closed
16 days ago
Comments count
1
Uncaught exception input sequence_length is >= max_length
Closed
17 days ago
Comments count
7
Performance Regression in DML
Updated
17 days ago
Comments count
1
Conda package release ?
Closed
17 days ago
Comments count
3
Using software adapter crashes DirectML helper
Updated
18 days ago
How to use Phi3 ONNX model in Triton efficiently?
Updated
23 days ago
Comments count
1
Convert Llama-3-awq To Llama-3-awq-onnx
Closed
24 days ago
Comments count
2
Usage example for `get_output()`
Closed
25 days ago
Comments count
7
[DML] [iGPU] [AMD] [Intel] GPU command exception
Updated
25 days ago
Comments count
1
How to get the Token length in .NET
Closed
a month ago
Comments count
4
DLL load failed while importing onnxruntime_genai: 动态链接库(DLL)初始化例程失败。
Closed
a month ago
Comments count
4
import onnxruntime causes model load to abort
Closed
a month ago
Comments count
1
[DirectML] [v0.3.0] Dynamic link library not found.
Closed
a month ago
Comments count
4
Is there any example on how to run on gorilla open functions
Closed
a month ago
Comments count
2
is there any exmaple of phi-3 vision model deploy on Android?
Updated
a month ago
Comments count
7
Support for Execution Providers - QNN
Closed
a month ago
Comments count
2
Support for Vision models like Phi3 Vision and Microsoft's Florence 2?
Closed
a month ago
Comments count
2
Support for microsoft/Florence-2-large-ft vision model
Closed
a month ago
Comments count
7
Fix the README in the nuget package to show C# code
Updated
a month ago
Unable to install and run Phiv3 vision
Closed
a month ago
Comments count
5
Onnxruntime-genai with Phi3 produces nonsense on LicheePi4A ( RISCV- XuanTie C910 )
Closed
a month ago
Comments count
6
UnicodeDecodeError when try to run Phi-3-vision
Closed
a month ago
Comments count
1
"Specified provider is not supported" when just loading models in C#
Closed
a month ago
Comments count
2
GPU driver error when using AMD eGPU via DirectML
Updated
a month ago
Error importing package with DML
Closed
a month ago
Comments count
1
ImportError for genai library in python on DirectML EP with 0.3.0 release
Closed
a month ago
Comments count
2
Fail to build for iOS from latest code base
Closed
a month ago
Comments count
4
GPU suspended (887A0005) while running Phi2 example in DML
Updated
a month ago
Comments count
1
More API parameters could be const
Updated
a month ago
Cannot get device_type from Python API
Closed
2 months ago
No support for multiple image while using Phi-3-vision (Inference)
Closed
2 months ago
Comments count
1
Previous
Next