provide more demo
963658029 opened this issue · comments
Can you provide a demo of captioning, which is to input a folder containing a large number of videos and output the caption of the video?
hi @963658029, we have the recaption recipe to help caption a bunch of videos. In this case, you need to download our models in huggingface and run on your own machine.
To use your own dataset, you should replace the video folders and annotation.json here: https://github.com/magic-research/PLLaVA/blob/6c81a8867574dc44ee7a96319297fdc976a867a4/tasks/eval/recaption/__init__.py#L212C1-L213C1
To run, use the script:
Line 46 in 6c81a88
We will update the readme to show this functionality soon.
