fluxcd / notification-controller

The GitOps Toolkit event forwarded and notification dispatcher

Home Page:https://fluxcd.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Telegram notification sometimes don't work

coding4food opened this issue · comments

Describe the bug

Notification controller can not send messages on failed helm releases like this:

Helm install failed for release xxx/yyy with chart xxx@1.2.3: failed pre-install: 1 error occurred:
	* timed out waiting for the condition

Last Helm logs:

2024-02-02T11:02:35.934027667Z: Add/Modify event for redbox: MODIFIED
2024-02-02T11:02:35.934035281Z: xxx: Jobs active: 1, jobs failed: 3, jobs succeeded: 0
2024-02-02T11:04:50.423095535Z: Add/Modify event for redbox: MODIFIED
2024-02-02T11:04:50.423106642Z: xxx: Jobs active: 1, jobs failed: 3, jobs succeeded: 0
2024-02-02T11:04:51.564419695Z: Add/Modify event for redbox: MODIFIED
2024-02-02T11:04:51.564426867Z: xxx: Jobs active: 1, jobs failed: 3, jobs succeeded: 0
2024-02-02T11:04:51.749744768Z: Add/Modify event for redbox: MODIFIED
2024-02-02T11:04:51.749751843Z: xxx: Jobs active: 1, jobs failed: 4, jobs succeeded: 0
2024-02-02T11:04:54.354833888Z: Add/Modify event for redbox: MODIFIED
2024-02-02T11:04:54.354840647Z: xxx: Jobs active: 1, jobs failed: 4, jobs succeeded: 0

Error message:

{"level":"error","ts":"2024-02-02T10:55:32.748Z","logger":"event-server","msg":"failed to send notification","eventInvolvedObject":{"kind":"HelmRelease","namespace":"xxx","name":"yyy-release","uid":"26c0b237-6a1c-4651-8d23-fa09e103d47e","apiVersion":"helm.toolkit.fluxcd.io/v2beta2","resourceVersion":"9273505"},"Alert":{"name":"all-releases","namespace":"xxx"},"error":"Bad Request: can't parse entities: Can't find end of Bold entity at byte offset 1062"}

Steps to reproduce

  1. Set up telegram notifications for alerts
  2. Create helm release with failing pre-install hook

Expected behavior

Messages on failed releases get sent.

Screenshots and recordings

image

OS / Distro

Oracle Linux 8

Flux version

v2.2.2

Flux check

N/A

Git provider

GitLab OSS

Container Registry provider

Harbor

Additional context

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct