blip2

There are 2 repositories under blip2 topic.

DAMO-NLP-SG / Video-LLaMA
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
large-language-models video-language-pretraining vision-language-pretraining blip2 llama minigpt4 cross-modal-pretraining multi-modal-chatgpt
Language:Python 2814
sled-group / chat-with-nerf
Chat with NeRF enables users to interact with a NeRF model by typing in natural language.
blip2 chatgpt gpt-4 lerf nerf nerfstudio
Language:Python 304
mlpc-ucsd / BLIVA
(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions
blip2 bliva chatbot instruction-tuning llama llm lora multimodal visual-language-learning
Language:Python 269
SmithaUpadhyaya / fashion_image_caption
Automate Fashion Image Captioning using BLIP-2. Automatic generating descriptions of clothes on shopping websites, which can help customers without fashion knowledge to better understand the features (attributes, style, functionality etc.) of the items and increase online sales by enticing more customers.
blip2 huggingface-datasets huggingface-transformers image image-caption-generator transformer multimodal-deep-learning
Language:Jupyter Notebook 47
152334H / MiniGPT-4-discord-bot
A true multimodal LLaMA derivative -- on Discord!
ai blip2 discord-bot llama llm multimodal vicuna
Language:Python 44
eric-ai-lab / ComCLIP
Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"
blip2 causality clip compositionality flickr30k flickr8k-dataset image-text-matching image-text-retrieval slip svo vision-and-language winoground
Language:Python 33
kyegomez / qformer
Implementation of Qformer from BLIP2 in Zeta Lego blocks.
ai artificial-intelligence attention-mechanism blip2 machine machine-learning multi-modal multi-modality
Language:Python 31
BUAADreamer / SPN4CIR
[ACM MM 2024] Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negatives
acmmm2024 blip blip2 clip composed-image-retrieval cross-modal-retrieval data-generation image-retrieval llama llava memory-bank multi-modal-retrieval multimodal-learning transformer
Language:Python 14
nngocson2002 / ViVQA
The Multimodal Model for Vietnamese Visual Question Answering (ViVQA)
bartpho beit-3 blip2 efficientnet multimodal-deep-learning vqa vivqa
Language:Python 12
ZhaoPeiduo / BLIP2-Japanese
Modifying LAVIS' BLIP2 Q-former with models pretrained on Japanese datasets.
blip2 captioning japanese multimodal-deep-learning pytorch
Language:Python 11
matlok-ai / bampe-weights
This repository is for profiling, extracting, visualizing and reusing generative AI weights to hopefully build more accurate AI models and audit/scan weights at rest to identify knowledge domains for risk(s).
ai blip2 foundational-models generative-ai gptq image-to-image llm safetensors stable-diffusion tiff transformers weights blender blender-python deep-learning
Language:Python 9
MichiganNLP / visual_diversity_budget
Annotations on a Budget: Leveraging Geo-Data Similarity to Balance Model Performance and Annotation Cost
active-learning align blip2 clip datasets multimodal-deep-learning geo-diverse computer-vison diversity-analysis
8
jacobmarks / fiftyone-image-captioning-plugin
Caption images across your datasets with state of the art models from Hugging Face and Replicate!
blip2 computer-vision fiftyone fuyu huggingface huggingface-transformers image-captioning llava qwen
Language:Python 7
aws-samples / visual-question-answering-finetuning
Finetuning Large Visual Models on Visual Question Answering
blip2 finetuning genai vqa
Language:Jupyter Notebook 6
craigsdennis / scairy
Uses AI to scare people...more.
ai blip2 elevenlabs halloween llama2 replicate sadtalker
Language:Python 4
leeyunjai / image2text
caption generator using lavis and argostranslate
caption caption-generation caption-generator captioning-images captions image-analysis image-text img2txt blip2
Language:Python 4
otdavies / AIOrganizeMyDesktop
Too lazy to organize my desktop, make gpt + BLIP-2 do it
automation desktop example-project gpt-3 organization python ai blip2 machinelearning
Language:Python 2
shreyassks / Stylised-Image-Captions-with-RL-PPO
Creating stylish social media captions for an Image using Multi Modal Models and Reinforcement Learning
blip2 image-captions proximal-policy-optimization reinforcement-learning swin-transformers adaptive-scst personality-captions
Language:Jupyter Notebook 1
notslok / Image-Caption-Generator
An end to end Deep Learning based tool for image caption generation.
blip2 gradio pegasus-paraphrase tool transformers-models
Language:Jupyter Notebook 0
Pavansomisetty21 / Visual-Question-Answering-using-Gemini-LLM
In this we explore into visual Question Answering Using Gemini LLM and image was in URL or any other extension
blip blip2 gemini gemini-flash git question-answering vision-language-model vision-transformer visual-question-answering vlm vqa artificial-intelligence generative-ai generative-model visual-models
Language:Jupyter Notebook 0

blip2

DAMO-NLP-SG / Video-LLaMA

sled-group / chat-with-nerf

mlpc-ucsd / BLIVA

SmithaUpadhyaya / fashion_image_caption

152334H / MiniGPT-4-discord-bot

eric-ai-lab / ComCLIP

kyegomez / qformer

BUAADreamer / SPN4CIR

nngocson2002 / ViVQA

ZhaoPeiduo / BLIP2-Japanese

matlok-ai / bampe-weights

MichiganNLP / visual_diversity_budget

jacobmarks / fiftyone-image-captioning-plugin

aws-samples / visual-question-answering-finetuning

craigsdennis / scairy

leeyunjai / image2text

otdavies / AIOrganizeMyDesktop

shreyassks / Stylised-Image-Captions-with-RL-PPO

notslok / Image-Caption-Generator

Pavansomisetty21 / Visual-Question-Answering-using-Gemini-LLM