next-game-solutions / ml-inference-using-aws-lambda-and-amazon-efs

Machine Learning Inference using AWS Lambda and Amazon EFS

Repository for deploying multiple machine learning models for inference on AWS Lambda and Amazon EFS

Introduction

In this repo, you will find all the code needed to deploy your application for Machine Learning Inference using AWS Lambda and Amazon EFS.

Application Workflow

Here is the architectural work flow of our application:

• Create a serverless application which will trigger a Lambda function upon a new model upload in your S3 bucket. And the function would copy that file from your S3 bucket to EFS File System

• Create another Lambda function that will load the model from Amazon EFS and performs the prediction based on an image.

• Build and deploy both the application using AWS Serverless Application Model (AWS SAM) application.

Architecture

To use the Amazon EFS file system from Lambda, you need the following:

• An Amazon Virtual Private Cloud (Amazon VPC)
• An Amazon EFS file system created within that VPC with an access point as an application entry point for your Lambda function.
• A Lambda function (in the same VPC and private subnets) referencing the access point.

The following diagram illustrates the solution architecture:

Create an Amazon EFS file system, access point, and Lambda function

Now, we are going to use a single SAM deployment to deploy this, which will create the following two serverless applications, let’s call it :

• app1(s3-efs): The serverless application which will transfer the uploaded ML models from your S3 bucket to the your EFS file system
• app2(ml-inference): The serverless application which will perform the ML Inference from the client.

Demo walkthrough

Here is a quick walkthrough of the demo:

demo.mp4

Feedback

Let us know what you thought of this lab and how we can improve the experience for you in the future by completing this poll. Participants who complete the surveys from AWS Innovate - AI/ML Edition will receive a gift code for USD25 in AWS credits. Here is the feedback Form

AWS credits will be sent via email by 31 March, 2022.

Note: Only registrants of AWS Innovate - AI/ML Edition who complete the surveys will receive a gift code for USD25 in AWS credits via email.

• 
• Limited to 1 x USD 25 AWS credits per participant.
• Participants will be required to provide their business email addresses to receive the gift code for AWS credits.

And for queries about the AWS Innovate - AI/ML Edition and credit codes, please contact : [e-mail]