Seal prometheus metrics empty

[Chris Stanaway]

With PowerfulSeal 3.1.0:

$ curl http://localhost:8001/api/v1/namespaces/kube-system/pods/powerfulseal-85f968c9d9-tsmjj:9090/proxy/metrics
# HELP process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE process_virtual_memory_bytes gauge
process_virtual_memory_bytes 355807232.0
# HELP process_resident_memory_bytes Resident memory size in bytes.
# TYPE process_resident_memory_bytes gauge
process_resident_memory_bytes 101650432.0
# HELP process_start_time_seconds Start time of the process since unix epoch in seconds.
# TYPE process_start_time_seconds gauge
process_start_time_seconds 1620169478.13
# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds.
# TYPE process_cpu_seconds_total counter
process_cpu_seconds_total 70.86
# HELP process_open_fds Number of open file descriptors.
# TYPE process_open_fds gauge
process_open_fds 12.0
# HELP process_max_fds Maximum number of open file descriptors.
# TYPE process_max_fds gauge
process_max_fds 1048576.0
# HELP python_info Python platform information
# TYPE python_info gauge
python_info{implementation="CPython",major="3",minor="7",patchlevel="9",version="3.7.9"} 1.0
# HELP seal_pod_kills_total Number of pods killed (including failures)
# TYPE seal_pod_kills_total counter
# HELP seal_nodes_stopped_total Number of nodes stopped (including failures)
# TYPE seal_nodes_stopped_total counter
# HELP seal_execute_failed_total Increasing counter for command execution failures
# TYPE seal_execute_failed_total counter
# HELP seal_empty_filter_total Increasing counter for cases where filtering returns an empty result
# TYPE seal_empty_filter_total counter
seal_empty_filter_total 0.0
# HELP seal_probability_filter_not_passed_total Increasing counter for cases where the probability filter does not pass any nodes
# TYPE seal_probability_filter_not_passed_total counter
seal_probability_filter_not_passed_total 0.0
# HELP seal_empty_match_total Increasing counter for cases where matching returns an empty result
# TYPE seal_empty_match_total counter
seal_empty_match_total{source="nodes"} 0.0
seal_empty_match_total{source="pods"} 0.0
# HELP seal_scenario_runs_total Counter of runs of scenarios (both success and failure)
# TYPE seal_scenario_runs_total counter
seal_scenario_runs_total{name="scenario 1",result="success"} 196.0
seal_scenario_runs_total{name="scenario 2",result="success"} 196.0
seal_scenario_runs_total{name="scenario 3",result="success"} 196.0
seal_scenario_runs_total{name="scenario 4",result="success"} 196.0

While seal has been running and killing pods (no node scenarios defined), the following metrics are not being reported:

• seal_pod_kills_total (should be reported as non-zero)
• seal_nodes_stopped_total (should be reported as zero)
• seal_execute_failed_total (should be reported as zero - nothing failed per logs)

[Shivam Negi]

I am also facing the same issue