Latency SLOs may be invalid

Question

Latency SLOs may be invalid

sethvargo opened this issue 4 years ago · comments

We had a small spike in latency for 0.6s. All the SLO latency alerts continued to fire for over an hour, even after latency dropped to normal. Even an hour later, the SlowBurn graphs haven't dropped even though latency has been normal for a long time.

/cc @yegle @mariliamelo @yuriatgoogle

Seth Vargo · Answer 1 · Thu Dec 31 2020 07:43:14 GMT+0800 (China Standard Time)

Seth Vargo commented 4 years ago

Yuri Grinshteyn · Answer 2 · Thu Dec 31 2020 23:07:01 GMT+0800 (China Standard Time)

I think deleting the alerting policies makes it so it's hard to see what all happened....

Seth Vargo · Answer 3 · Mon Jan 11 2021 02:17:26 GMT+0800 (China Standard Time)

/close

We've refactored our policies

Google OSS Prow Robot · Answer 4 · Mon Jan 11 2021 02:17:27 GMT+0800 (China Standard Time)

@sethvargo: Closing this issue.

In response to this:

/close

We've refactored our policies

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.