salesforce / LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

salesforce/LAVIS Issues

generated output error
Updated 7 days ago
How can I change cache_root?
Closed 7 days ago
cache_version Value Error
Closed 9 days ago
Blip2-caption only generate "a photo of"
Closed 10 days ago
How is `Total Params` calculated?
Updated 12 days ago
safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge
Updated 13 days ago2
CUstom dataset Inference
Updated 14 days ago
How are Learned Queries generated? What line of code is implemented?
Updated 14 days ago
About Text Preprocessing of InstructBLIP
Updated 14 days ago
what should be samples["text_output"] during finetuning
Updated 21 days ago3
AttributeError: 'NoneType' object has no attribute 'from_pretrained'
Updated 23 days ago1
Why do I always encounter CUDA out of memory problem when I load the load_model_process function? Can the RTX 3090 be used for the BLIP-2 model?"
Updated 23 days ago1
How should I use blip2 for vqa task training?
Updated 25 days ago4
Use BLIP-2 for Image Captioning
Updated a month ago1
Loss calculation across GPUs using all_gather_with_grad function
Updated a month ago
salesforce-lavis 1.0.2 requires transformers<4.27,>=4.25.0, but you have transformers 4.40.0 which is incompatible.
Updated a month ago
How to fine-tune BLIP-2 on a local Chinese dataset?
Updated a month ago3
XInstructBLIP demo text generation
Updated a month ago
how to deal with “Missing keys ”
Updated a month ago1
huggingface_hub.utils._validators.HFValidationError: Repo id must use alphanumeric chars or '-', '_', '.', '--' and '..' are forbidden, '-' and '.' cannot start or end the name, max length is 96: ''.
Updated a month ago
How to replicate BLIP-2 results with a dataset that is already dowloaded?
Updated a month ago2
how use it output target class。
Updated 2 months ago
How can I calculate the similarity between multimodal features and Unimodal features
Closed 2 months ago
Input of multiple images
Updated 2 months ago
Potentially wrong inherence in lavis.datasets.datasets.base_dataset
Updated 2 months ago
OPT2.7B underperforming & weird behavior compared to flant5xl on image captioning?
Updated 2 months ago5
How to run InstructBLIP with other LLM model
Updated 2 months ago
Image use to present LAVIS
Updated 2 months ago
The role of modeling_opt.py in the BLIP2 model
Updated 2 months ago
The results of DocVQA, infoVQA, and OCRVQA evaluating the instructblip model are very low
Closed 2 months ago
Can existing large datasets be used to fine tune the blip2 caption task?
Updated 2 months ago
Score difference in ITM and ITC ?
Updated 2 months ago
ModuleNotFoundError: No module named 'lavis.models.blip_diffusion_models'
Updated 2 months ago
instruct-blip output long meanless string
Updated 2 months ago1
question about text localization
Updated 2 months ago
Compatibility Issue with Different Versions of Transformers
Updated 3 months ago
Error occurred during BLIP2-demo execution
Updated 3 months ago1
When using instructblip to evaluate the okvqa data set, there is nothing in the output path
Closed 3 months ago
How does VQA works on BLIP2 without LLM?
Updated 3 months ago1
[Bug] AttributeError: 'list' object has no attribute 'view'
Closed 3 months ago5
Why checkpoints are not saved?
Updated 3 months ago
About the lables in the VQA task using OPT models
Updated 3 months ago
Segmentation Fault
Updated 3 months ago
How to extract features from custom finetuned BLIP2 model on HuggingFace?
Updated 3 months ago
The relevant code for this job of img2llm
Updated 3 months ago
'Blip2OPT' object has no attribute 'forward_encoder_image'
Updated 3 months ago
Where are the loss functions for ITC, ITM, and ITG in the first stage of training in blip2？
Updated 3 months ago
In which licensing category does the blip_vqa license fall?
Updated 3 months ago
file.json for dataset
Closed 3 months ago1
All notebook show Not found!
Updated 3 months ago