linuxstudio / etcd-tools

Tools to troubleshoot ETCD performance in OpenShift

openshift etcd-tools

etcd-mg.sh

ETCD script will make collect info from MUST-GATHER, make little summary and search for errors/issues and explains what are expected values. To use it, run

./etcd-mg.sh [full path to MUST-GATHER]

or if you're missing clusterversion in your logs, here is exa

./etcd-mg.sh [full path to MUST-GATHER] false 4.10

PS: false parameter is to disable gnuplot use

must-gather-log_merger.sh

will combine logs from ETCD, haproxy, router, apiserver into one timeline printing only errors/warnings.

./must-gather-log_merger.sh -m

etcd-analyzer.sh

do

oc login

./etcd-analyzer.sh

and it will print summary of warnings, size of ETCD and number of objects.

cleanup-analyzer.sh

do

oc login

./cleanup-analyzer.sh

and it will print number of deployments, replicasets and how many of them are inactive and could be cleaned up.

fio_suite

fio_suite is benchmark tool which runs several fio tests to see how IOPS change under different load.

Run

./fio_suite.sh

or on RHCOS/Openshift

$ oc debug node/<master_node>
  [...]
  sh-4.4# chroot /host bash
  podman run --privileged --volume /var/lib/etcd:/test quay.io/peterducai/openshift-etcd-suite:latest fio