koverholt / palm-vertex-ai-chatbot

A chatbot implementation with the PaLM API in Google Cloud with a Gradio chatbot app

palm-vertex-ai-chatbot

An example chatbot app with Gradio that uses the PaLM API from Vertex AI in Google Cloud

Usage

1. Clone this repository and cd into the src/ directory.

2. Install the required dependencies:

   pip install -r requirements.txt
   

3. Set up authentication in Google Cloud using your preferred method. For example, you can use gcloud auth to generate credentials for client libraries, as in:

   gcloud auth application-default login
   

4. Run the app:

   python src/app.py
   

5. Navigate to http://127.0.0.1:8080/ in your browser.

6. Start chatting with your PaLM-powered chatbot!

Deploy to Cloud Run

The above steps allow you to test and use the chatbot app on your local machine. You can use a fully managed service such as Cloud Run to publish your app.

1. From the src/ directory, run the following command using the gcloud CLI:

   gcloud run deploy chatbot-app --source . --allow-unauthenticated --region us-central1
   

2. After a couple of minutes, your chatbot app will be deployed on Cloud Run, and you can access the app via a URL similar to:

   https://chatbot-app-r5gdynozbq-uc.a.run.app/