gpt4v

There are 9 repositories under gpt4v topic.

• mnotgod96 / AppAgent

  AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

  agentchatgptgenerative-aigpt4gpt4vllm
  Language:Python 5154

• X-PLUG / MobileAgent

  Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

  agentandroidappautomationcopilotgpt4vguiharmonyiosmllmmobilemobile-agentsmultimodalmultimodal-agentmultimodal-large-language-models
  Language:Python 3015

• reworkd / tarsier

  Vision utilities for web interaction agents 👀

  ocrplaywrightseleniumwebscrapingpypi-packagegpt4vllmspython
  Language:Jupyter Notebook 1450

• AmberSahdev / Open-Interface

  Control Any Computer Using LLMs

  assistantassistant-computer-controlautomationgptgpt4gpt4vgpt4visionlinuxllmmachine-learningmacosopenaipyautoguipyinstallerpythonself-drivingself-driving-softwarewindows
  Language:Python 722

• bdekraker / WebcamGPT-Vision

  Lightweight GPT-4 Vision processing over the Webcam

  chatgptcomputer-visiongpt-4gpt4-apigpt4vopenai
  Language:JavaScript 274

• langgptai / Awesome-Multimodal-Prompts

  Prompts of GPT-4V & DALL-E3 to full utilize the multi-modal ability. GPT4V Prompts, DALL-E3 Prompts.

  chatgptgpt4multimodalprompt-engineeringpromptsgpt4vnewbingmultimodal-promptsawesomeawesome-listjailbreak-promptprompt-injectiondall-edall-e3dall-e3-prompts
  220
• vscode-ui-sketcher

  pAIrprogio / vscode-ui-sketcher

  Draw your projects to life

  gpt4vtldrawui-designvscode-extension
  Language:TypeScript 194

• ShareGPT4Omni / ShareGPT4V

  [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

  chatgpteccv2024gptgpt-4vgpt4vinstruction-tuninglanguage-modellarge-language-modelslarge-multimodal-modelslarge-vision-language-modelsvision-language-model
  Language:Python 157
• amazing-openai-api

  soulteary / amazing-openai-api

  Convert different model APIs into the OpenAI API format out of the box.

  azure-openaiazure-openai-apigemini-progoogle-geminiopenaiopenai-apiyi-34byi-34b-chatgpt4vgpt4vision
  Language:Go 146

• zzxslp / MM-Navigator

  GPT-4V in Wonderland: LMMs as Smartphone Agents

  gpt4vllm-agentsweb-navigation
  Language:Python 128

• kyegomez / MambaByte

  Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta

  aiartificial-intelligencegpt4vmachine-learningmambamegabytemlmulti-modalitytokenizer
  Language:Python 109
• sketch2app

  cameronking4 / sketch2app

  The ultimate sketch to code app made using GPT4o serving 25k+ users. Choose your desired framework (React, Next, React Native, Flutter) for your app. It will instantly generate code and preview (sandbox) from a simple hand drawn sketch on paper captured from webcam

  gpt4-visionsketch2codewireframegpt4vdesign2codepad2pixelsketch2appai-toolapp-makercode-generatorgpt4generate-app-aicode-assistantnextjsopenai
  75

• admineral / GPT4-Vision-React-Starter

  Early Alpha Release: Chat with Your Image - Leveraging GPT-4 Vision and Function Calls for AI-Powered Image Analysis and Description

  gpt4gpt4-apigpt4vopenaiopenaiapiaichatgpt-apigpt-4-vision-previewopenai-apigpt4-vision
  Language:TypeScript 73

• BUAADreamer / Chinese-LLaVA-Med

  中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine

  llavamedicalmllmmultimodalchineseqwen1-5aigpt4vhuggingface-datasetsminigpt4transformersllama-factory
  Language:Python 52

• martintomov / gpt4v-video-voiceover

  Video Voiceover with GPT4V

  gpt4vjupyter-notebookopenaipythonstreamlit
  Language:Jupyter Notebook 32

• roboflow / gpt-checkup

  Monitor the performance of OpenAI's GPT-4V model over time.

  computer-visiongpt-4vgpt4vmodel-analysis
  Language:HTML 31

• neka-nat / mylangrobot

  Language instructions to mycobot using GPT-4V

  chatgptgpt4vmycobotsegment-anythingwhispergpt-4-visiongpt-4-vision-preview
  Language:Python 18

• kyegomez / HRTX

  Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2

  aiartificial-intelligenceensemblegpt4vmachine-learningmlmulti-modalmulti-modalityrt-2rtx
  Language:Python 17

• logicalroot / gpt-4v-demos

  🤖 GPT-4V Demos • Test the model's vision capabilities in your browser using Streamlit • Easy setup

  gpt-4openaipythonstreamlitgpt-4vgpt4gpt4v
  Language:Python 17

• reidbarber / webmarker

  Mark web pages for use with vision-language models

  promptprompt-engineeringsomvision-language-modelset-of-markclaudegeminigpt4ogpt4vllmsplaywrightqwen-vl
  Language:TypeScript 16

• Charmve / gpt-eyes

  I GAVE GPT-4 EYES!

  agentgpt-4gpt-4ogpt-4omnigpt4gpt4vllmllm-inferenceworld-modelworld-modelsworldmodel
  Language:JavaScript 14

• Azure-Samples / rag-as-a-service-with-vision

  This repository offers a Python framework for a retrieval-augmented generation (RAG) pipeline using text and images from MHTML documents, leveraging Azure AI and OpenAI services. It includes ingestion and enrichment flows, a RAG with Vision pipeline, and evaluation tools.

  azure-ai-searchazure-ai-visioncosmosdbgpt-4ogpt4vgpt4visionllmopenairagvision
  Language:Python 11

• GraphPKU / CoI

  Chain of Images for Intuitively Reasoning

  chatbotchatgptdalle3gpt4vllamallavamultimodalvisual-language-modelschain-of-imagechain-of-throught
  Language:Python 8

• easonlai / webcam_chat_with_aoai_gpt4o

  Discover the GPT-4o multimodal model at Microsoft Build 2024, now with text and image capabilities. My prototype enhances chats with real-time camera snapshots, powered by Flask, OpenCV, and Azure’s OpenAI Services. It’s interactive, visual, and simple to use. Give it a try!

  azure-openaiazure-openai-apiazureopenaiflaskflask-webgptgpt4gpt4ogpt4vmicrosoftazureopenaiopencv-pythonpythonpython3
  Language:HTML 6

• elizabethsiegle / stephensmithify-openaivision-sendgrid

  Analyze a Video and generate commentary about it with OpenAI's GPT-4V, Text-to-speech, LangChain, Streamlit, Replit, Twilio SendGrid, and OpenCV!

  gpt4vlangchainopenaiopenai-apiopencv-pythonreplitsendgridstreamlitopenai-v
  Language:Python 5

• danomation / Discord-Vision-Bot

  poc gpt-4 vision bot

  discordgpt-4-vision-previewgpt4vopenaipycordvision
  Language:Python 4

• dceluis / vacocam_render

  Vision-Assisted Camera Orientation

  artificial-intelligencecomputer-visionffmpeggpt4gpt4-apigpt4-visiongpt4v
  Language:Jupyter Notebook 4

• yunwoong7 / GPT-4V-Examples

  Explore the power of GPT-4V with our curated examples and tutorials. This repository offers code snippets, step-by-step guides, and use case demonstrations for integrating GPT-4V into various applications. Perfect for both AI novices and experts!

  examplesgpt4vopenaipythontutorials
  Language:Jupyter Notebook 3

• Envedity / DAIA

  Digital Artificial Intelligence Agent

  agiaiai-agentllmllm-agentmachine-learningmlauto-agentai-vision-modelgpt4vgpt4vision
  Language:Python 2

• gpt4api9 / gpt4api9

  麻雀GPTs-API市场

  gpt35turbogpt4gpt4all-apigpt4apigpt4vopenai
  2

• ethan-yz-hao / equation-ocr-app

  OCR application for converting handwritten equations into LaTeX code using OpenAI's GPT-4V API, with LaTeX renderer for editing and checking (Next.js, Typescript, OpenAI GPT-4V, KaTex, Vercel)

  gpt4vkatexnextjsopenaitypescriptvercel
  Language:TypeScript 1

• jamesponddotco / allalt

  [READ-ONLY] Describe images and generate alt tags for visually impaired users.

  a11ya11y-automationaccessibilitygogolanggpt4vopenai
  Language:Go 1

• Ravi-Teja-konda / TunedLlavaDelights

  Explore the rich flavors of Indian desserts with TunedLlavaDelights. Utilizing the in Llava fine-tuning, our project unveils detailed nutritional profiles, taste notes, and optimal consumption times for beloved sweets. Dive into a fusion of AI innovation and culinary tradition

  nutritiondessertllavamultimodalnutrition-informationchatgptfinetuninggpt4gpt4vllama2multi-modalityvision-language-modeldalle2stable-diffusiontranformersvision-language-learning
  Language:Python 1

• sagentic-ai / cupid

  Valentine's Day Cupid Agent

  aichatbotgpt4gpt4vllmbazed-af
  Language:TypeScript 1

• yunwoong7 / VisionQuery-GPT-4v

  VisionQuery GPT-4v is a cutting-edge tool that combines screenshot-based queries with OpenAI's GPT-4. It enables users to capture screens, ask questions, and receive insightful answers from GPT-4v, revolutionizing digital interaction and understanding.

  classificationface-recognitiongpt4vgpt4visionimage-recognitionobject-detectionocropenai-apipython
  Language:Jupyter Notebook 1

• metatatt / iso_bot

  ISO 13485 Sniffer Bot, GPT4V with LlamaIndex embeded in React Bot UI

  chatbotgpt4vllamaindexmlnextjsreact
  Language:TypeScript 0