intel / intel-npu-acceleration-library

Intel® NPU Acceleration Library

intel/intel-npu-acceleration-library Issues

Profiling and Allocation Control for Partially Offloaded Models
Updated 13 days ago3
Failed to run Phi-3-mini-4k-instruct (int4) on Windows
Updated 14 days ago9
Phi-3-mini-4k-instruct (INT4) model compile error
Closed 14 days ago1
NPU compiled Llama3 (int4) model not working if prompt size is large
Updated 14 days ago2
Does this library work with wsl2?
Updated 14 days ago6
What Intel CPU can we run this library ?
Closed 14 days ago1
[Bug] when cache read on Phi-3 example, error occur.
Closed 14 days ago3
Persistent Compiled Model for Intel NPU Acceleration Library
Closed 15 days ago2
[Bug] int8 quantization not working except tiny llama
Closed 15 days ago5
[Question]NPU is slower than CPU when computing some types of matmul.
Closed 15 days ago4
"OSError: [WinError -529697949] Windows Error 0xe06d7363 “ - While running llama3 on NPU
Closed 16 days ago2
Get confused of why Llama example can run on win10
Closed 21 days ago4
profile_llm.py fails with default arguments
Closed 21 days ago6
Installing package from source fails
Closed 21 days ago1
microsoft/phi-2 model outputs nonsense on NPU
Closed 21 days ago6
pip install intel-npu-acceleration-library ERROR
Closed a month ago2
DirectML vs This Package
Updated a month ago
ERROR: Failed building wheel for intel-npu-acceleration-library
Closed 2 months ago2
[Bug] Tiny Llama sample not works properly
Closed 2 months ago4
support whisper model.
Closed 2 months ago1
Need help with OSError: [WinError -529697949] Windows Error 0xe06d7363
Closed 2 months ago5
Why is the matrix multiplication slower after I installed the NPU driver?
Closed 2 months ago9
CPU and NPU Hybrid Training Model
Updated 3 months ago1
Can you clarify if the NPU is the same component as the GNA and are both supported?
Closed 3 months ago1
Add support for BitNet b1.58 quantization
Updated 3 months ago4
Request to provide a RAG example?
Closed 3 months ago12
AttributeError: property 'pad_token_id' of 'ChatGLMTokenizer' object has no setter
Updated 3 months ago2
[OSError][WinError-529697949][Intel Meteorlake] Error when try to run example matmul.py
Closed 3 months ago3
Future Plan about this library.
Updated 3 months ago
What Intel CPU can we run this library ?
Closed 4 months ago
Keras support
Updated 4 months ago