elizabethsiegle / stephensmithify-openaivision-sendgrid

Analyze a Video and generate commentary about it with OpenAI's GPT-4V, Text-to-speech, LangChain, Streamlit, Replit, Twilio SendGrid, and OpenCV!

Generate NBA Commentary in the style of someone with Stephen Smith-like qualities using

• Twilio SendGrid
• OpenAI GPT-4V API (and OpenAI TTS)
• Replit
• LangChain
• OpenCV

You can test out the app on Replit here or play with the code on Replit here

Thank you to my coworker and AccelerateSF teammate Chris Brox for helping with the YouTube video!

Prereqs

• Twilio SendGrid account - make an account here and make an API key here
• An email address to test out this project
• A Replit account for hosting the application – make an account here
• OpenAI account - make an account here and find your API key here

You'll add your secret keys to Replit as such

Dependencies:

• moviepy to help process video and audio
• cv2 (OpenCV) to help handle video frames
• langchain to read and parse a CSV for relevant statistics
• openai for OpenAI's GPT-4V and text-to-speech (TTS) APIs
• requests for making HTTP requests to OpenAI's API
• streamlit to create a web-based UI in Python
• tempfile to help handle temporary files while processing

These are added to Replit by clicking on packages: