imyoungyang / ai-accelerators-examples

Examples of AI Accelerators - GPU, AWS Inferential and Elastic Inference

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

This repository contains examples for deep learning inference deployment using AI accelerators:

* Amazon EC2 G4 instances with NVIDIA T4 GPUs and NVIDIA TensorRT

* Amazon EC2 Inf1 instances with AWS Inferentia and AWS Neuron SDK

* Amazon EC2 CPU instances with Amazon Elastic Inference

* Amazon SageMaker deployment hosting for CPUs, GPUs and AWS Inferentia

About

Examples of AI Accelerators - GPU, AWS Inferential and Elastic Inference

License:Apache License 2.0


Languages

Language:Jupyter Notebook 100.0%