GoToCloud is a cloud-computing-based platform for advanced data analysis and data management for Cryo-EM SPA.
The following instructions are for using the GoToCloud platform provided by KEK.
Instructions on how to build your own GoToCloud platform are provided at the end.
For more information, see: https://sites.google.com/sbrc.jp/gotocloud-doc/procedure
You should create Cloud9 from AWS console first.
- Navigate to Cloud9 console page.
- Create environment.
- Enter "Project name" (e.g. protein-240101) into "Name" box.
- Select "Amazon Linux 2" in "Platform".
- Select "Secure Shell (SSH)" in "Connection".
- Select "Name - kek-gtc-user-vpc" in "Amazon Virtual Private Cloud (VPC)".
- Select "Name - kek-gtc-user-subnet1" in "Subnet".
- Create Cloud9.
- Open Cloud9 IDE.
Then, execute the following commands in Cloud9 terminal to setup GoToCloud envornment.
cd ~/environment
wget https://kek-gtc-master-s3-bucket.s3.ap-northeast-1.amazonaws.com/gtc_setup_gotocloud_environment.sh
chmod 755 ~/environment/gtc_setup_gotocloud_environment.sh
./gtc_setup_gotocloud_environment.sh
Open the new Cloud9 terminal and create parallelcluster using the following command.
gtc_pcluster_create.sh
Connect to the ParallelCluster head ndoe created above via niceDCV.
gtc_pcluster_dcv_connect.sh
or via SSH
gtc_pcluster_ssh.sh
If you won't be using Parallelcluster it is recommended to delete the ParallelCluster to stop billing for the relatively expensive head node and Lustre. you can delete parallelcluster using the following command.
gtc_pcluster_delete.sh
you can delete delete GoToCloud after the project is completed. Delete AWS S3 bucket and EC2 key pair.
gtc_aws_delete_s3_and_key_pair.sh
Finally, delete Cloud9 instance from the AWS Cloud9 console page.
You can construct your own GoToCloud platform by AWS CloudFormation. Our Web site describes the following steps are required. You can find more eraborated instruction here: https://sites.google.com/sbrc.jp/gotocloud-doc/build