hands-on-lab-neo4j-and-vertex-ai
Neo4j is the leading graph database vendor. We’ve worked closely with Google Cloud engineering for years. Our products, AuraDB and AuraDS are offered as managed services on Google Cloud. Neo4j Enterprise Edition, which includes Graph Database, Graph Data Science and Bloom is offered in the Google Cloud Marketplace.
In this hands on lab, you’ll get to learn about Neo4j and Google Cloud Vertex AI. The lab is intended for data scientists and data engineers. We’ll walk through deploying Neo4j and Vertex AI in your own Google Cloud account. Then we’ll get hands on with a real world dataset, building a machine learning pipeline that takes advantage of features generated using Neo4j Graph Data Science to improve prediction in Vertex AI. You’ll come out of this lab with enough knowledge to apply graph feature engineering to your own datasets.
We’re going to analyze the quarterly filings of asset managers with $100m+ assets under management (AUM). These are regulatory filings made to the Securities and Exchange Commission’s (SEC) EDGAR system. We’re going to show how to load that data from a Google Cloud Storage bucket into Neo4j. We’ll then explore the relationships of different asset managers and their holdings using the Neo4j Browser and Neo4j’s Cypher query language.
Finally, we’ll use Neo4j Graph Data Science to create a graph embedding from our data, export that out, and run supervised learning algorithms in Vertex AI. We’ll try to predict what holdings asset managers will maintain or enlarge in the next quarter.
If you’re in the capital markets space, we think you’ll be interested in potential applications of this approach to creating new features for algorithmic trading, understanding tail risk, securities master data management and so on. If you’re not in the capital markets space, this session will still be useful to learn about building machine learning pipelines with Neo4j and Vertex AI.
Venue
These workshops are organized onsite in a Google office.
Duration
3 hours.
Prerequisites
You'll need a laptop with a web browser. Your browser will need to be able to access the Google Cloud Console and port 7474 on a Neo4j deployment running on Google Cloud. If your laptop has a firewall you can't control on it, you may want to bring your personal laptop.
If you have a Google Cloud account with permissions that allow you to invoke Vertex AI, deploy from Marketplace and create a Cloud Storage bucket, then you can use that. If not, we'll walk you through creating a Google Cloud account.
Agenda
Part 1
- Introductions
- Lecture - Introduction to Neo4j (10 min)
- What is Neo4j?
- Customer use cases
- How is it deployed and managed on Google Cloud?
- Lab 0 - Signup for Google Cloud (15 min)
- Improving the Labs
- Signup for a Google Cloud Account
- Activate your Google Cloud account
- Lab 1 - Deploy Neo4j (15 min)
- Deploying Neo4j AuraDS Professional
- Lab 2 - Connect to Neo4j (10 min)
- Neo4j Workspace
- Break (10 min)
Part 2
- Lecture - Moving Data (10 min)
- LOAD CSV
- Apache Beam and Google Dataflow
- Apache Spark and Google Dataproc
- Apache Kafka and Cloud Cloud
- Lab 3 - Moving Data (15 min)
- A Day of Data
- A Year of Data
- Lab 4 - Exploration 10 min)
- Exploration with Neo4j Bloom
- Lab 5 - Vertex AI Workbench 15 min)
- Pandas
- Vertex AI Workbench
- Cypher Queries
- Break (10 min)
Part 3
- Lecture - Graph Data Science (10 min)
- Why Graph Data Science
- Neo4j GDS
- Algorithm Families and Examples
- Similarity
- Centrality
- Community Detection
- Graph Machine Learning
- Lab 6 - Graph Data Science (15 min)
- Creating a Graph Embedding
- Exporting to pandas
- Writing to Google Cloud Storage
- Lecture - Vertex AI (10 min)
- What is Vertex AI?
- Using Vertex AI with Neo4j
- Lab 7 - Vertex AI AutoML (15 min)
- Raw Data
- Data with Embedding
- Lab 8 - Cleanup (5 min)
- Discussion - Questions and Next Steps (5 min)