CloudSu

Designed to simplify the process of deploying highly available applications.

Requirements:

Chef Server https://manage.chef.io/login
AWS Account https://aws.amazon.com/
Node: Tested 4.0.0
NPM: Tested 2.14.2

Why should I use CloudSu?

CloudSu gets you started with chef in the AWS cloud in just a few minutes. Launching servers is as easy as filling out a form and all the chef tasks are automatically taken care of for you.

What will CloudSu create on my AWS account

CloudSu uses CloudFormation to create all of its resources so cleanup is a breeze. All resources created below will fall under the AWS Free Tier

DynamoDB Config Table - Accounts and settings data
DynamoDB Servers Table - Server Chef client key storage
SQS Queue - Used to store autoscale events
SNS Topic - Used for capturing autoscale events
IAM Config User - Full-access account for settings and accounts
IAM Server User - Read-only account for server table

How does CloudSu work

When you click create a new stack a few things happen in this order

A CloudFormation template is generated with all the options you chose in the form
A custom bootstrap is inserted into the CloudFormation template metadata
The CloudFormation template is sent to AWS to be created
A Chef environment is created with the same name as the CloudFormation stack with the options your chose in the form
CloudSU polls the SQS queue for new SNS events and finds the launch event for your new server(s)
A Chef client key is created for the launch event and placed in the DynamoDB Servers Table
The server(s) boot up script looks in the DynamoDB Servers Table with its InstanceId and copies the key to local disk
Chef is then installed on the server and a chef-client is initiated with the supplied run list in the stack form

What happens when I upgrade

CloudSu was designed to create new servers for each software release. The upgrade happens in this order to eliminate downtime and to provide a rollback option if needed.

Stage1:

Creates the new server(s)
Locks the previous software version at the chef node level for the old servers
Updates the chef environment to the new software version
Waits for the CloudFormation to return an UPDATE_COMPLETE status

Stage2: Connects the new server(s) to the load balancer

Stage3: Disconnects the old server(s) from the load balancer

Stage4: Cleans up your old servers or tags them for termination in the future

Setup:

$ npm install

$ node server.js

Environment Variables:

Redis cache (local cache will be used if REDIS_HOST is not set)

REDIS_HOST - IP address or hostname of your Redis server
REDIS_PORT - Redis server port
REDIS_PASSWORD - Redis password for authentication (not required)

Application settings

CLOUDSU_PORT - Http listening port for the server (default: 3000)
CLOUDSU_LOG_LEVEL - Winston log level (default: debug)
CLOUDSU_ENCYPTION_KEY - Encryption key used to encrypt and decrypt items in the database

API:

Headers (needed for each request)

{
  "aws_region": "us-west-2",
  "aws_account": "DEFAULT",
  "token":"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJuYW1lIjoiZHByaWNoYTE4OUBnbWFpbC5jb20iLCJpYXQiOjE0NjE2NDA1NTIsImV4cCI6MTQ2MTcyNjk1Mn0.EDxmnM_1H91H115grMxasdfasdfasdfaseeONMPc4wsGxI"
}

Create Stack

POST /api/v1/stacks/:stack_name

{
  "stack_name": "Testing",
  "instance_store": false,
  "ebs_volume": false,
  "multi_az": true,
  "ebs_root_size": 30,
  "volumes": [{ "type": "gp2", "size": 30 }],
  "recipes": ["recipe[nodejs]"],
  "build_size": "HA",
  "create_elb": true,
  "route_53": true,
  "hosted_zone": "cloudsu.io",
  "ebs_root_volume": true,
  "elb":{
     "ping_port": 443,
     "ping_protocol": "HTTPS",
     "ping_path": "/api/v1/status"
  },
  "min_size": 1,
  "desired_size": 1,
  "max_size": 3,
  "instance_size": "t2.nano",
  "key": "gator",
  "ami": "ami-c229c0a2",
  "app_name": "cloudsu",
  "app_version": "prod-1413",
  "domain": "cloudsu.io",
  "regions": ["us-west-2a", "us-west-2b", "us-west-2c"],
  "elb_security_groups": ["sg-adb4b6c8"],
  "security_groups": ["sg-adb4b6c8"]
 }

Upgrade Stack All Stages

PATCH /api/v1/upgrade

{
  "stack_name": "Testing",
  "min_size": 1,
  "desired_size": 1,
  "max_size": 3,
  "ami": "ami-c229c0a2",
  "instance_size": "t2.nano",
  "app_version": "prod13",
  "cleanup_type": "delete"
}

Upgrade Stack Stage 1

PATCH /api/v1/upgrade/stage1

{
  "stack_name": "Testing",
  "min_size": 1,
  "desired_size": 1,
  "max_size": 3,
  "ami": "ami-c229c0a2",
  "instance_size": "t2.nano",
  "app_version": "prod13"
}

Upgrade Stack Stage 2

PATCH /api/v1/upgrade/stage2

{
  "stack_name": "Testing"
}

Upgrade Stack Stage 3

PATCH /api/v1/upgrade/stage3

{
  "stack_name": "Testing",
}

Upgrade Stack Stage 4

PATCH /api/v1/upgrade/stage4

{
  "stack_name": "Testing",
  "cleanup_type": "delete"
}

dpricha89 / cloudsu