bench-tps-dos Test
This is a implementation for bench-tps-dos gist
Usage
Check bench-tps-dos-QUIC & bench-tps-dos-UDP in buildkite.
Environment in buildkite example
TEST_TYPE: "QUIC" # This will show on report
GIT_TOKEN: "xxxxx"
BUILD_SOLANA: "true"
SOLANA_BUILD_BRANCH: "master" # same-as-cluster / master /v1.10 / v1.10.32 ...
# api.inernal
NDPOINT: "http://123.123.123.123"
NUM_CLIENT: 2
SLACK_WEBHOOK: ""
USE_TPU_CLIENT: "false"
TPU_DISABLE_QUIC: "false" # add --tpu-disable-quic
DURATION: 1800
TX_COUNT: 2000
THREAD_BATCH_SLEEP_MS: 10
SUSTAINED: "true"
KEYPAIR_FILE: "xxxx.yaml"
KEEP_INSTANCES: "true" # do not delete instances after bench-tps test
- Mandatory: ENDPOINT / NUM_CLIENT / SLACK_WEBHOOK / TEST_TYPE
- BUILD_SOLANA: "true" to build bench-tps from solana source
- SOLANA_BUILD_BRANCH: git checkout branch/version to build solana (same-as-cluster/master/v1.10.32/10.1 ...etc.) default: same-as-cluster
- AVAILABLE_ZONE: zones to create google cloud instance. (Be aware of quota issue)
- NUM_CLIENT: 10 (default 10 for QUIC & 1 for UDP)
- USE_TPU_CLIENT/DURATION/TX_COUNT/SUSTAINED/THREAD_BATCH_SLEEP_MS arguments for bench-tps
- KEYPAIR_FILE: keypair_files to use
Flow
- creates NUM_CLIENT google clound instances
- builds solana to use the latest bench-tps (option)
- use BUILD_SOLANA=true to enable
- downloads and builds https://github.com/solana-labs/solana
- waits for NUM_CLIENT finishing build (blocking)
- starts UDP/QUIC bench-tps DOS test by runing scripts in the instances
- analyzes data by querying influxcloud
- sends report to slack channel(SLACK_WEBHOOK)
Files
- dos-run.sh Main process. To prepare environment variables, create google cloud instances, run benchmark and generate a report then send to slack
- start-build-solana.sh The script downloads and builds solana
- start-dos-test.sh The script runs bench-tps DOS test in dynamically created gc instances
- exec-start-template.sh This file is used to generate exec-start-build-solana.sh to execute start-build-solana.sh This file is used to generate exec-start-dos-test.sh to execute start-dos-test.sh
- dos-report-env.sh The script is stored in bench-tps-dos bucket. It is downloaded by start-dos-test.sh. It has confidential environment for executing start-dos-test.sh
- dos-report.sh The script generates a report from influxCloud and send it to a slack channel
- influx_data.sh The script stores flux commands.
Files in cloud storage
Private files are stored in bench-tps-dos bucket in cloud storage.
+ environment variables for report
+ a key to ssh to dynamically created google cloud instances
+ keypair files for bench-tps
+ key for bench-tps