huggingface / optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

https://huggingface.co/docs/optimum/main/en/intel/index

huggingface/optimum-intel Issues

How to apply LoRA adapter to a model loaded with OVModelForCausalLM()?
Closed 21 days ago5
Trying to export a bark model, that is a custom or unsupported architecture, but no custom export configuration was passed as `custom_export_configs`.
Updated a month ago
Support for Text-to-Speech models
Updated a month ago
OVStableDiffusionXLPipeline can't load model
Closed a month ago2
Fail to execute quantized model on Ray
Updated a month ago
Optimum cli does not exit after model quantization
Updated a month ago
Failed to remove Tmp directory on Windows after export openvino model
Updated a month ago1
issues with IPEXModel.from_pretrained with sentence-transformer models (all-MiniLM-L6-v2, intfloat/e5-mistral-7b-instruct)
Closed a month ago2
Issue while exporting internlm2-chat-7b model to OpenVINO format
Closed a month ago2
web documentation missing for ipex backend
Updated a month ago
[model enable] Request to enable gemma2 model exporting
Updated a month ago1
[model enable] Request to enable DeciLM-7B-instruct model exporting
Updated a month ago
Optimum TaskManager do not support SentenceTransformer.
Closed 2 months ago1
Need help with model compilation
Closed 2 months ago3
transformers version requirements conflicting with vLLM
Closed 2 months ago
Safety checker doesn't work with Latent Consistency Model pipeline
Closed 2 months ago
Openvino e5-small not working after conversion model
Closed 2 months ago2
Not able to load Intel/bge-base-en-v1.5-rag-int8-static model
Updated 2 months ago4
UnboundLocalError: local variable 'all_files' referenced before assignment
Closed 2 months ago1
Describe `OVModelForCausalLM.from_pretrained()` args
Closed 3 months ago3
incorrect documentation pipeline
Closed 3 months ago2
Pipeline accelerator defaults to 'ort' runtime instead of 'ipex'
Closed 3 months ago
Enable IPEXModel on XPU
Updated 3 months ago4
Broadcast incorrect target shape. Expecting either 1 or 126. Got 0
Closed 4 months ago7
Enable Image Classifier Output's last hidden state
Closed 4 months ago
Audio classification sample fails with error: can't pickle local object 'main.<locals>.train_transforms'
Closed 4 months ago1
TrOcr model to openvino IR model
Closed 4 months ago3
not suppoer IntermediateLayersKnowledgeDistillationLossConfig and SelfKnowledgeDistillationLossConfig?
Closed 4 months ago1
Issues about using pytorch FrontEnd convert NNCF QAT INT8 model to IR
Closed 4 months ago1
Intel NNCF functions for Pruning, Distilling and Quantizing for Seq2Seq Task
Closed 4 months ago1
List index out of range when trying to export with openvino
Closed 4 months ago2
Set a number of threads
Closed 4 months ago5
Safety checker is not working (OVStableDiffusionPipeline)
Closed 5 months ago3
Image inpainting is not working
Closed 5 months ago1
Core dump on Ubuntu Ubuntu 22.04.3 using optimum-intel 1.16.0.dev0+d2f9fdb
Closed 5 months ago2
Unable to quantize and compress local zeroscope_v2_576w model
Closed 5 months ago1
Memory not release after jit.trace
Closed 5 months ago
OVModelForSpeechSeq2Seq fails with return_timestamps="word".
Updated 5 months ago2
Image Classification Example is not working
Closed 5 months ago1
OVStableDiffusionPipeline.from_pretrained() and LatentConsistencyModelPipeline.from_pretrained() cause an exception by running in Windows
Closed 6 months ago1
Cannot load onnx checkpoint from huggingface repository
Closed 7 months ago6
llama 2 quantization
Closed 6 months ago4
inc is not a arguments of optimum-cli
Closed 7 months ago1
ModuleNotFoundError: No module named 'timm.layers'
Closed 10 months ago1
INCStableDiffusionPipeline toolkit
Closed a year ago3
Llama-2 model support in OVModelForCausalLM
Closed a year ago3
`StatisticsNotCollectedError` when running optimize stable diffusion
Closed a year ago2
'OVStableDiffusionPipeline' object has no attribute 'image_processor'
Closed a year ago2
Documentation for OpenVINO missing half()
Closed a year ago1
Add an option to disable OpenVINO model caching
Closed a year ago3