ClipSift is a tool for you to automatically speed up content / asset searching. By providing a natural lanaguage description, you can easily query the top relevant YouTube videos and get the most relevant clips to review. Copyrights reserved to the original creators of the videos.
To start using, you should have docker running and use Weaviate through docker, so you have a local, free vector database for later when we want to find the best matching video assets.
To setup, you can follow: Weaviate Starter's Guide
Or, simply run the following in your terminal:
export OPENAI_API_KEY="sk..."
docker compose up -dAdditionally, you need YOUTUBE_API_KEY. You can obtain one from Google's Cloud platform for free and create a project for free. You can follow the linked here to do so: How to get Youtube API Key
inside top level main.py, change the prompt to the keyword you are trying to serach
then run:
python main.pyto remove duplicate in the database:
python clean_duplicate_in_db.pyto remove downloaded assets under youtube_downloads
sh clean_downloaded_video.shThe entire project has two major parts:
- video search and download
- transcript and clip
This is to ensure scalable design for downloading more platform's assets
This dir contains all you need to download any video based on a text entry description, example: Python Linked List definition -> GPT will generate key words to use to search -> Query YouTube's database -> Download and done!
This dir contains all you need to process the transcripts and find the best matching contents and corp it automatically for you to use. By default, the same instruction for video search step will be shared here as instruction to find the best match, but you can manually change it as well. In here we index all the documents, send it to the weaviate docker instance, and query it to do hybrid search to find the best matching snippets of videos. Lastly, we crop them and store on the top level, so you can directly use it in your video.
Located on the top level, under output_clips