scylladb / 1m-ops-demo

1 million operations/second ScyllaDB demo

ScyllaDB 1 million operations/second DEMO

This demo shows you how to set up infrastructure with Terraform and run a 1 million ops/sec load on ScyllaDB Cloud cluster. This repo is a great starting point for you to test ScyllaDB Cloud under heavy load and simulate your own workload you expect ScyllaDB to handle. Watch the video tutorial here!

Infrastructure elements

• ScyllaDB Cloud cluster
• Amazon Web Services (AWS) EC2 instances (three "loader" machines will make the database requests)

Prerequisites

• AWS account and CLI credentials (more information on acquiring the credentials here and here, for OKTA you can use gimme-aws-creds)
• ScyllaDB Cloud API token (get your API token here)
• Terraform installed on your machine (installation instructions here)

AWS permissions

Make sure that you have sufficient AWS permissions to create the following items:

• VPC
• Subnets
• Security groups
• EC2 instances (three)

Get started

Clone the repository:

git clone https://github.com/scylladb/scylladb-1m-ops-demo.git
cd scylladb-1m-ops-demo/

First, set the required items in variables.tf:

#
# Set the following variables (mandatory)
#

# ScyllaDB Cloud API token
variable "scylla_cloud_token" {
  description = "ScyllaDB Cloud API token"
  type        = string
  default     = "ADD-YOUR-API-TOKEN-HERE"
}

# ScyllaDB Cloud region
variable "scylla_cloud_region" {
  description = "ScyllaDB Cloud region of the cluster"
  type        = string
  default     = "eu-north-1"
}

# SSH private key for EC2 instance access
variable "ssh_private_key" {
  description = "SSH private key location for EC2 instance access"
  type        = string
  default     = "/home/user/Documents/your-private-key.pem"
}

variable "aws_key_pair" {
  description = "Key pair name in AWS"
  type        = string
  default     = "my-key-pair"
}

# AWS credentials file
variable "aws_creds" {
  description = "AWS credentials location"
  type        = string
  default     = "/home/user/.aws/credentials"
}

Start setting up infrastructure with Terraform:

terraform init
terraform plan
terraform apply

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

[...]

Apply complete! Resources: 23 added, 0 changed, 0 destroyed.

Setting up the infrastructure takes 15+ minutes. Once Terraform is finished it takes another 2-3 minutes to reach 1M ops/sec.

Go to ScyllaDB Cloud console, select your newly created cluster ScyllaDB-Cloud-Demo and open Monitoring to see the workload live: After finishing the demo, don't forget to destroy the infrastructure to avoid unnecessary costs:

terraform destroy