intel / intel-npu-acceleration-library

Intel® NPU Acceleration Library

intel/intel-npu-acceleration-library Issues

cannot compile the depthwise conv when it is included in other models
Closed 3 days ago2
NPU compiled Llama3 (int4) model not working if prompt size is large
Updated 3 days ago3
Problem with 'generate_with_static_shape' function
Closed 3 days ago4
Failed to run Phi-3-mini-4k-instruct (torch.int8) on Windows #45
Closed 4 days ago9
RuntimeError occurs when run quantized int8 Llama-2-7b-hf
Closed 4 days ago5
Dose linear support input_tensor with dtype int8?
Updated 4 days ago3
NPU utilization for maths problems
Updated 5 days ago6
NPU computation is not fully occupied while running LLM model
Updated 9 days ago2
Compile question about using c++ API.
Closed 10 days ago2
cannot compile `nn.Sequential` into float32
Closed 10 days ago4
Failed to run Phi-3-mini-4k-instruct (int4) on Windows
Closed 11 days ago9
Profiling and Allocation Control for Partially Offloaded Models
Updated 15 days ago3
Phi-3-mini-4k-instruct (INT4) model compile error
Closed 16 days ago1
Does this library work with wsl2?
Updated 16 days ago6
What Intel CPU can we run this library ?
Closed 16 days ago1
[Bug] when cache read on Phi-3 example, error occur.
Closed 16 days ago3
Persistent Compiled Model for Intel NPU Acceleration Library
Closed 17 days ago2
[Bug] int8 quantization not working except tiny llama
Closed 17 days ago5
[Question]NPU is slower than CPU when computing some types of matmul.
Closed 17 days ago4
"OSError: [WinError -529697949] Windows Error 0xe06d7363 “ - While running llama3 on NPU
Closed 18 days ago2
Get confused of why Llama example can run on win10
Closed 23 days ago4
profile_llm.py fails with default arguments
Closed 23 days ago6
Installing package from source fails
Closed 23 days ago1
microsoft/phi-2 model outputs nonsense on NPU
Closed 23 days ago6
pip install intel-npu-acceleration-library ERROR
Closed a month ago2
DirectML vs This Package
Updated a month ago
ERROR: Failed building wheel for intel-npu-acceleration-library
Closed 2 months ago2
[Bug] Tiny Llama sample not works properly
Closed 2 months ago4
support whisper model.
Closed 2 months ago1
Need help with OSError: [WinError -529697949] Windows Error 0xe06d7363
Closed 2 months ago5
Why is the matrix multiplication slower after I installed the NPU driver?
Closed 2 months ago9
CPU and NPU Hybrid Training Model
Updated 3 months ago1
Can you clarify if the NPU is the same component as the GNA and are both supported?
Closed 3 months ago1
Add support for BitNet b1.58 quantization
Updated 3 months ago4
Request to provide a RAG example?
Closed 3 months ago12
AttributeError: property 'pad_token_id' of 'ChatGLMTokenizer' object has no setter
Updated 3 months ago2
[OSError][WinError-529697949][Intel Meteorlake] Error when try to run example matmul.py
Closed 3 months ago3
Future Plan about this library.
Updated 4 months ago
What Intel CPU can we run this library ?
Closed 4 months ago
Keras support
Updated 4 months ago