Giters

salesforce / BLIP

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Convert BLIP model to TensorRT

Frostbite22 opened this issue · comments

commented

Hello,
Is there any any to convert BLIP to TensorRT to have a lighter model on inference time ?

I have tried to convert the model to ONNX first ( then I will convert it to TensorRT in the next step) but I failed.

commented

Any update? I also faiiled to convert BLIP model to TorchScript.

Hello, Is there any any to convert BLIP to TensorRT to have a lighter model on inference time ?

I have tried to convert the model to ONNX first ( then I will convert it to TensorRT in the next step) but I failed.