oaapao/GPT-based-Short-Video-Understanding

Understanding Short-Videos Using GPT

project_description

Getting Started

This is an example of how you may give instructions on setting up your project locally. To get a local copy up and running follow these simple example steps.

Prerequisites

This is an example of how to list things you need to use the software and how to install them.

Install ffmpeg

for mac
```
brew install ffmpeg
```
for ubuntu
```
sudo apt-get install ffmpeg
```

Installation

Get a OpenAI ChatGPT API Key at https://chat.openai.com and a Azure speech API key at https://portal.azure.com

Clone the repo

git clone https://github.com/oaapao/GPT-based-Short-Video-Understanding.git

Install python packages

conda create -n gpt python=3.11
conda activate gpt
pip install -r requirements.txt

Enter your API Key in ~/.bashrc or ~/.zshrc

vi ~/.zshrc
export CHATGPT_AK={your_sk}
export AZURE_KEY={your_sk}

Usage

Use this space to show useful examples of how a project can be used. Additional screenshots, code examples and demos work well in this space. You may also link to more resources.

Prepare your video data
Changing your prompt in chat_with_function_call.py
Run chat_with_function_call.py

python chat_with_function_call.py

Roadmap

Convert video to speech
Convert speech to text
ChatGPT function call works
Add download_douyin in available_functions and functions
Automate search video by keyword in Douyin (web crawler related)
Upgrade prompt

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!

Fork the Project
Create your Feature Branch (git checkout -b feature/AmazingFeature)
Commit your Changes (git commit -m 'Add some AmazingFeature')
Push to the Branch (git push origin feature/AmazingFeature)
Open a Pull Request

oaapao / GPT-based-Short-Video-Understanding