bollig / pcluster-manager

Manage AWS ParallelCluster through an easy to use web interface

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ParallelCluster Manager - Make HPC Easy

This project is a front-end for AWS Parallel Cluster

Quickly and easily create HPC cluster in AWS using ParallelCluster Manager. This UI uses the AWS ParallelCluster 3.0 API to Create, Update and Delete Clusters as well as access, view logs, and build Amazon Machine Images (AMI's).

Want to request a new feature?

  1. First checkout the Roadmap
  2. If you don't already see your feature, open a feature request

You can get started with your first cluster in as little as 15 minutes using the links below.

Quickstart (15 mins) 🚀

Launch the stack in your AWS account by clicking on one of the below regions:

Region Launch
Ohio (us-east-2) Launch
North Virginia (us-east-1) Launch
Ireland (eu-west-1) Launch
Frankfurt (eu-central-1) Launch
More Regions (Click to expand)
Region Launch
Oregon (us-west-2) Launch
California (us-west-1) Launch
London (eu-west-2) Launch
Paris (eu-north-1) Launch
Stockholm (eu-north-1) Launch
Middle East (me-south-1) Launch
South America (sa-east-1) Launch
Canada (ca-central-1) Launch
Hong Kong (ap-east-1) Launch
Tokyo (ap-northeast-1) Launch
Seoul (ap-northeast-2) Launch
Mumbai (ap-south-1) Launch
Singapore (ap-southeast-1) Launch
Sydney (ap-southeast-2) Launch
GovCloud West (us-gov-west-1) Launch

Enter your email and wait (~15 mins) for the stack to go into CREATE_COMPLETE. Using the code from your email login to the Web UI at the address specified by the PclusterManagerUrl in the Outputs tab of the main pcluster-manager stack.

CloudFormation Outputs

For more details see the Getting Started Guide.

Screen Shot

Main Page

System Architecture

ParallelCluster Manager Architecture

Costs

ParallelCluster Manager is built on a serverless architecture and falls into the free tier for most uses. I've detailed the dependency services and their free-tier limits below:

Service Free Tier
Cognito 50,000 Monthly Active Users
API Gateway 1M Rest API Calls
Lambda 1M free requests / month & 400,000 GB-seconds of compute / month
Image Builder No-Cost except EC2
EC2 ~15 mins one-time to build Container Image

Typical usage will likely cost < $1 / month.

Updating

To update the the latest version, run the following, make sure to set the region to where you deployed the stack:

git clone https://github.com/aws-samples/pcluster-manager.git
cd pcluster-manager/
./scripts/update.sh --region us-east-1  # should be region where stack is deployed

Local Development

To run AWS ParallelCluster Manager locally, start by setting the following environment variables:

export AWS_ACCESS_KEY_ID=[...]
export AWS_SECRET_ACCESS_KEY=[...]
export AWS_DEFAULT_REGION=us-east-2
export API_BASE_URL=https://[API_ID].execute-api.us-east-2.amazonaws.com/prod  # get this from ParallelClusterApi stack outputs

Start the API backend by running:

./scripts/run_flask.sh

Start the React frontend by running:

cd frontend/
npm install # if this is your first time starting the frontend
npm start

Then navigate to http://localhost:3000

Security

See CONTRIBUTING for more information.

License

This project is licensed under the Apache-2.0 License.

About

Manage AWS ParallelCluster through an easy to use web interface

License:Apache License 2.0


Languages

Language:JavaScript 82.4%Language:Python 11.5%Language:Shell 3.7%Language:CSS 1.0%Language:HTML 0.8%Language:Ruby 0.5%Language:Dockerfile 0.2%