The problem is on the server with OS Windows Server 2016

Question

The problem is on the server with OS Windows Server 2016

aropb opened this issue 7 months ago · comments

Hi,

I really liked your product. It runs fast on Windows 10 and Linux Debian. But it doesn't run on Windows Server 2016.
I really hope for a solution to the problem.

Thanks.

Errors:

Error in System log:

Faulting module name: tbbbind_2_5.dll, version: 2021.2.2.0, time stamp: 0x6454504a
Exception code: 0xc0000005
Fault offset: 0x0000000000002c2b

I removed tbbbind* DLLs:

The type initializer for 'Sdcb.OpenVINO.Natives.NativeMethods' threw an exception.
System.TypeInitializationException: The type initializer for 'Sdcb.OpenVINO.Natives.NativeMethods' threw an exception.
---> System.TypeInitializationException: The type initializer for 'Sdcb.OpenVINO.Natives.OpenVINOLibraryLoader' threw an exception.
---> System.DllNotFoundException: Unable to load native library: openvino_c.dll, dependencies status:
openvino.dll:0

  at Sdcb.OpenVINO.Natives.OpenVINOLibraryLoader.LoadWithDeps(Assembly assembly, Nullable`1 searchPath, LibDeps[] libDeps)
  at Sdcb.OpenVINO.Natives.OpenVINOLibraryLoader.OpenVINOImportResolver(String libraryName, Assembly assembly, Nullable`1 searchPath)
  at System.Runtime.InteropServices.NativeLibrary.LoadLibraryCallbackStub(String libraryName, Assembly assembly, Boolean hasDllImportSearchPathFlags, UInt32 dllImportSearchPathFlags)
  at Sdcb.OpenVINO.Natives.NativeMethods.ov_get_openvino_version(ov_version* version)
  at Sdcb.OpenVINO.OVCore.get_Version()
  at Sdcb.OpenVINO.Natives.OpenVINOLibraryLoader..cctor()
  --- End of inner exception stack trace ---
  at Sdcb.OpenVINO.Natives.OpenVINOLibraryLoader.Init()
  at Sdcb.OpenVINO.Natives.NativeMethods..cctor()
  --- End of inner exception stack trace ---
  at Sdcb.OpenVINO.Natives.NativeMethods.ov_core_create(ov_core** core)
  at Sdcb.OpenVINO.OVCore.CreateHandle()
  at Sdcb.OpenVINO.OVCore..ctor()
  at Sdcb.OpenVINO.OVCore.<>c.<.cctor>b__24_0()
  at System.Lazy`1.ViaFactory(LazyThreadSafetyMode mode)
  at System.Lazy`1.ExecutionAndPublication(LazyHelper executionAndPublication, Boolean useDefaultConstructor)
  at System.Lazy`1.CreateValue()
  at Sdcb.OpenVINO.OVCore.get_Shared()
  at Sdcb.OpenVINO.DeviceOptions.DefaultCreateOVCore()
  at Sdcb.OpenVINO.BaseModel.CreateCompiledModel(DeviceOptions options, Action`1 afterReadModel, Action`2 prePostProcessing, Action`1 afterBuildModel, Action`1 afterCompiledModel)
  at Sdcb.OpenVINO.PaddleOCR.PaddleOcrRecognizer..ctor(RecognizationModel model, DeviceOptions deviceOptions, Nullable`1 staticShapeWidth)
  at (RecognizationModel, DeviceOptions, Nullable`1)
  at ???????????.???????????(RecognizationModel, DeviceOptions, Nullable`1)
  at WebAccountServer.Utils.OcrEngine..ctor(String publishDirectory)
  at (String)
  at ???????????.???????????(String)
  at WebAccountServer.Program.Init(Boolean isService, String[] args)
  at WebAccountServer.Program.Main(String[] args)
  at ???????????.???????????(TaskAwaiter&)
  at WebAccountServer.Program.<Main>(String[] args)

Unhandled exception. System.TypeInitializationException: The type initializer for 'Sdcb.OpenVINO.Natives.NativeMethods' threw an exception.
---> System.TypeInitializationException: The type initializer for 'Sdcb.OpenVINO.Natives.OpenVINOLibraryLoader' threw an exception.
---> System.DllNotFoundException: Unable to load native library: openvino_c.dll, dependencies status:
openvino.dll:0
at Sdcb.OpenVINO.Natives.OpenVINOLibraryLoader.LoadWithDeps(Assembly assembly, Nullable1 searchPath, LibDeps[] libDeps) at Sdcb.OpenVINO.Natives.OpenVINOLibraryLoader.OpenVINOImportResolver(String libraryName, Assembly assembly, Nullable1 searchPath)
at System.Runtime.InteropServices.NativeLibrary.LoadLibraryCallbackStub(String libraryName, Assembly assembly, Boolean hasDllImportSearchPathFlags, UInt32 dllImportSearchPathFlags)
at Sdcb.OpenVINO.Natives.NativeMethods.ov_get_openvino_version(ov_version* version)
at Sdcb.OpenVINO.OVCore.get_Version()
at Sdcb.OpenVINO.Natives.OpenVINOLibraryLoader..cctor()
--- End of inner exception stack trace ---
at Sdcb.OpenVINO.Natives.OpenVINOLibraryLoader.Init()
at Sdcb.OpenVINO.Natives.NativeMethods..cctor()
--- End of inner exception stack trace ---
at Sdcb.OpenVINO.Natives.NativeMethods.ov_core_create(ov_core** core)
at Sdcb.OpenVINO.OVCore.CreateHandle()
at Sdcb.OpenVINO.OVCore..ctor()
at Sdcb.OpenVINO.OVCore.<>c.<.cctor>b__24_0()
at System.Lazy1.ViaFactory(LazyThreadSafetyMode mode) at System.Lazy1.ExecutionAndPublication(LazyHelper executionAndPublication, Boolean useDefaultConstructor)
at System.Lazy1.CreateValue() at Sdcb.OpenVINO.OVCore.get_Shared() at Sdcb.OpenVINO.DeviceOptions.DefaultCreateOVCore() at Sdcb.OpenVINO.BaseModel.CreateCompiledModel(DeviceOptions options, Action1 afterReadModel, Action2 prePostProcessing, Action1 afterBuildModel, Action1 afterCompiledModel) at Sdcb.OpenVINO.PaddleOCR.PaddleOcrRecognizer..ctor(RecognizationModel model, DeviceOptions deviceOptions, Nullable1 staticShapeWidth)

aropb · Answer 1 · Fri Dec 22 2023 23:27:56 GMT+0800 (China Standard Time)

Your PaddleSharp is running on Windows Server at the same time.

Aven · Answer 2 · Sat Dec 23 2023 14:07:57 GMT+0800 (China Standard Time)

You can use Dependency Walker to inspect whether the dependencies of openvino_c.dll are normal.

aropb · Answer 3 · Sat Dec 23 2023 16:42:02 GMT+0800 (China Standard Time)

Unfortunately, I am not a system engineer, it will be difficult for me to understand what the problem is and find a solution. That's why I wrote here. I spent all day yesterday trying to find the requirements for running VINO on Windows Server or known issues. I didn't find anything. The official website is empty. I only see that VINO should work on Windows Server in principle. I only need to use the CPU. I have enabled CPU usage. I ask you, as a pro in this matter, to help me understand what the problem may be. Thank you.

Aven · Answer 4 · Sat Dec 23 2023 18:25:05 GMT+0800 (China Standard Time)

DW is straightforward to use. simply drag the openvino_c.dll and openvino.dll onto DW,
then check if any dynamic libraries are marked in yellow by DW.
It might be looks like the attached image below.

aropb · Answer 5 · Sun Dec 24 2023 19:55:19 GMT+0800 (China Standard Time)

Thanks, I'll try.
Another question: if I will definitely use only the CPU, can I exclude unnecessary DLL files from the project?

Am I enabling CPU usage correctly?

var ocr = new PaddleOcrRecognizer(new FileRecognizationModel(ocrPath + "english", ocrPath + "en_dict.txt", ModelVersion.V3), new Sdcb.OpenVINO.DeviceOptions("CPU"));

Thanks.

ZHOU Jie · Answer 6 · Mon Dec 25 2023 11:25:54 GMT+0800 (China Standard Time)

Have you installed vcredist2015-2022 on your WS2016? https://aka.ms/vs/17/release/vc_redist.x64.exe

aropb · Answer 7 · Mon Dec 25 2023 14:08:50 GMT+0800 (China Standard Time)

Yes, PaddleSharp is working on the same server

aropb · Answer 8 · Mon Dec 25 2023 21:52:08 GMT+0800 (China Standard Time)

You can use Dependency Walker to inspect whether the dependencies of openvino_c.dll are normal.

dwi.zip

Please help me understand what is missing.
Is there no latest version of VC Redist?
Is it possible to include the necessary versions of VC libraries in the project?

Thanks.

aropb · Answer 9 · Tue Dec 26 2023 01:27:55 GMT+0800 (China Standard Time)

The most interesting thing is that I have OpenVINO running on Windows 10, but DW shows errors:

ZHOU Jie · Answer 10 · Tue Dec 26 2023 11:19:52 GMT+0800 (China Standard Time)

can you try again with https://github.com/lucasg/Dependencies
this one should works better, you can try inspect openvino.dll instead of openvino_c.dll

aropb · Answer 11 · Tue Dec 26 2023 18:16:11 GMT+0800 (China Standard Time)

This utility shows me problems, although everything is working.

aropb · Answer 12 · Wed Dec 27 2023 20:18:13 GMT+0800 (China Standard Time)

The same thing on Windows Server where it does not work, DW no longer shows errors.
All the DLLs are clean!

It turns out that the problem is something else.
VMware virtualization is used. Any ideas?

Is it possible to turn off the infer_precision CPU:bf16 mode and turn on f32 precision?

aropb · Answer 13 · Thu Dec 28 2023 04:11:29 GMT+0800 (China Standard Time)

I found what the problem is, because of virtualization.
I set num_streams=1 and everything worked.