microsoft / onnxruntime-genai

Generative AI extensions for onnxruntime

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Device API throws exception

natke opened this issue · comments

From the last question in #430

From @AshD

@yufenglee I tried calling Utils.GetCurrentGpuDeviceId() in C# using the Microsoft.ML.OnnxRuntimeGenAI.DirectML 0.2.0-rc6 nuget

and it threw a
Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: 'CUDA and/or ROCM execution provider is either not enabled or not available.'

Same error on Utils.SetCurrentGpuDeviceId(1)

@natke is this still an issue?

commented

Just ran the same code with DirectML nuget 0.3.0-rc2. Same error.

Reproduced with 0.3.0