sfujiwara / vertex-ai-template

Vertex AI Template

A template for typical machine learning projects using Vertex AI.

Architecture

flowchart LR
  scheduler(Cloud Scheduler) -- HTTP Request --> functions(Cloud Functions)
  functions --> vertex(Vertex AI Pipelines)
  registry(Artifact Registry) -. Pipeline YAML .-> vertex
  registry -. Dcoker Image .-> vertex

Loading

Requirements

• Poetry
• Google Cloud SDK
• Terraform

Installation

poetry install

poetry shell

Deployment

Terraform

Create Google Cloud Platform resources with Terraform:

inv terraform.init -f invoke-dev.yaml

inv terraform.apply -f invoke-dev.yaml

Docker

Build Docker images for Vertex AI Pipelines components:

inv docker.build -f invoke-dev.yaml

Push Docker images:

inv docker.push -f invoke-dev.yaml

Pipeline

Generate pipeline YAML with Kubeflow Pipelines SDK:

inv pipeline.build -f invoke-dev.yaml

Upload pipeline YAML to Google Cloud Artifact Registry:

inv pipeline.push -f invoke-dev.yaml