trojblue / captioning

caption playground

captioning

caption playground

Submodules:

git submodule add <repository_url> repositories/<repository_name>
cd repositories/<repository_name>
git checkout <commit_sha>

cd ../..
git commit -am "Add <repository_name> submodule at <commit_sha>"

InstructBlip:

https://github.com/salesforce/LAVIS/tree/main/projects/instructblip

Install:

LAVIS:

git clone https://github.com/salesforce/LAVIS.git
cd LAVIS
pip install -e .

vicuna 13B v1.1 (huggingface format):

aws s3 sync s3://mewtant-ai-models/llm/vicuna-13b-f79578f/ ./vicuna13b

配置vicuna:

cd ~/dev/LAVIS
nano lavis/configs/models/blip2/blip2_instruct_vicuna13b.yaml

# llm_model: "/home/ubuntu/dev/anucuiv-b31"

demo:

cd ~/dev/LAVIS/projects/instructblip/
python run_demo.py