Hyo Choi's repositories
llmops-promptflow-template
LLMOps with Prompt Flow is a "LLMOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Management, Variant and Hyperparameter Experimentation, A/B Deployment, reporting for all runs and experiments and so on.
azureai-samples
Official community-driven Azure AI Examples
aws-ai-ml-workshop-kr
A collection of localized (Korean) AWS AI/ML workshop materials for hands-on labs.
aws-neuron-samples
Example code for AWS Neuron SDK developers building inference and training applications
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
optimum-benchmark
A unified multi-backend utility for benchmarking Transformers, Timm, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
optimum-neuron
Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
triton_python_backend
Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
keras-mmoe
A TensorFlow Keras implementation of "Modeling Task Relationships in Multi-task Learning with Multi-gate Mixture-of-Experts" (KDD 2018)
aws-inferentia
This repository provides an easy hands-on way to get started with AWS Inferentia. A demonstration of this hands-on can be seen in the AWS Innovate 2023 - AIML Edition session.
eks-ha-dr_aws-terraform
cx eks DR test
terraform-aws-sagemaker
Terraform Module: Amazon SageMaker
amazon-sagemaker-examples
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
amazon-sagemaker-studio-vpc-networkfirewall
This solution demonstrates the setup and deployment of Amazon SageMaker Studio into a private VPC and implementation of multi-layer security controls, such as data encryption, network traffic monitoring and restriction, usage of VPC endpoints, subnets and security groups, IAM resource policies.
anycommerce
E-Commerce demo application.
awesome-production-machine-learning
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
sm-model-serving-patterns
SageMaker Model Serving Patterns
tensorflow
An Open Source Machine Learning Framework for Everyone
sm-pipeline
SageMaker pipeline with abalone dataset