blip2

There are 1 repository under blip2 topic.

DAMO-NLP-SG / Video-LLaMA
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
blip2 cross-modal-pretraining large-language-models llama minigpt4 multi-modal-chatgpt video-language-pretraining vision-language-pretraining
Language:Python 2501
sled-group / chat-with-nerf
Chat with NeRF enables users to interact with a NeRF model by typing in natural language.
blip2 chatgpt gpt-4 nerf nerfstudio lerf
Language:Python 269
mlpc-ucsd / BLIVA
(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions
blip2 chatbot instruction-tuning llama llm multimodal visual-language-learning bliva lora
Language:Python 231
PaddlePaddle / PaddleMIX
Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.
aigc stable-diffusion blip2 clip minigpt4 image-to-text text-to-image ppdiffusers controlnet multimodal eva-clip sd-xl text-to-video dit llava qwen-vl sora stablevideodiffusion
Language:Python 229
152334H / MiniGPT-4-discord-bot
A true multimodal LLaMA derivative -- on Discord!
ai blip2 discord-bot llama llm multimodal vicuna
Language:Python 44
SmithaUpadhyaya / fashion_image_caption
Automate Fashion Image Captioning using BLIP-2. Automatic generating descriptions of clothes on shopping websites, which can help customers without fashion knowledge to better understand the features (attributes, style, functionality etc.) of the items and increase online sales by enticing more customers.
blip2 huggingface-datasets huggingface-transformers image image-caption-generator transformer multimodal-deep-learning
Language:Jupyter Notebook 38
eric-ai-lab / ComCLIP
Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"
blip2 causality clip compositionality flickr30k flickr8k-dataset image-text-matching image-text-retrieval slip svo vision-and-language winoground
Language:Python 25
kyegomez / qformer
Implementation of Qformer from BLIP2 in Zeta Lego blocks.
ai artificial-intelligence attention-mechanism blip2 machine machine-learning multi-modal multi-modality
Language:Python 17
matlok-ai / bampe-weights
This repository is for profiling, extracting, visualizing and reusing generative AI weights to hopefully build more accurate AI models and audit/scan weights at rest to identify knowledge domains for risk(s).
ai blip2 foundational-models generative-ai gptq image-to-image llm safetensors stable-diffusion tiff transformers weights blender blender-python deep-learning
Language:Python 8
MichiganNLP / visual_diversity_budget
Annotations on a Budget: Leveraging Geo-Data Similarity to Balance Model Performance and Annotation Cost
active-learning align blip2 clip datasets multimodal-deep-learning geo-diverse computer-vison diversity-analysis
8
ZhaoPeiduo / BLIP2-Japanese
Modifying LAVIS' BLIP2 Q-former with models pretrained on Japanese datasets.
captioning japanese pytorch blip2 multimodal-deep-learning
Language:Python 7
jacobmarks / fiftyone-image-captioning-plugin
Caption images across your datasets with state of the art models from Hugging Face and Replicate!
blip2 computer-vision fiftyone fuyu huggingface huggingface-transformers image-captioning llava qwen
Language:Python 5
craigsdennis / scairy
Uses AI to scare people...more.
ai blip2 elevenlabs halloween llama2 replicate sadtalker
Language:Python 4
leeyunjai / image2text
caption generator using lavis and argostranslate
blip2 caption caption-generation caption-generator captioning-images captions image-analysis image-text img2txt
Language:Python 4
otdavies / AIOrganizeMyDesktop
Too lazy to organize my desktop, make gpt + BLIP-2 do it
automation desktop example-project gpt-3 organization python ai blip2 machinelearning
Language:Python 2
shreyassks / Stylised-Image-Captions-with-RL-PPO
Creating stylish social media captions for an Image using Multi Modal Models and Reinforcement Learning
blip2 image-captions proximal-policy-optimization reinforcement-learning swin-transformers adaptive-scst personality-captions
Language:Jupyter Notebook 1
notslok / Image-Caption-Generator
An end to end Deep Learning based tool for image caption generation.
blip2 gradio pegasus-paraphrase tool transformers-models
Language:Jupyter Notebook 0

blip2

DAMO-NLP-SG / Video-LLaMA

sled-group / chat-with-nerf

mlpc-ucsd / BLIVA

PaddlePaddle / PaddleMIX

152334H / MiniGPT-4-discord-bot

SmithaUpadhyaya / fashion_image_caption

eric-ai-lab / ComCLIP

kyegomez / qformer

matlok-ai / bampe-weights

MichiganNLP / visual_diversity_budget

ZhaoPeiduo / BLIP2-Japanese

jacobmarks / fiftyone-image-captioning-plugin

craigsdennis / scairy

leeyunjai / image2text

otdavies / AIOrganizeMyDesktop

shreyassks / Stylised-Image-Captions-with-RL-PPO

notslok / Image-Caption-Generator