Prometheus job generated by the PodMonitor does not exclude non-running pods. All the "completed" Pods are still going to be listed as targets in Prometheus and marked as down. This issue is related to PodMonitor implementation and is discussed in prometheus-operator/prometheus-operator#4816
Signed-off-by: Arcadie Condrat <arcadie.condrat@gmail.com>
- add loki-stack HelmRelease to install Loki and Promtail in the monitoring namespace
- make the loki-stack HelmRelease depend on kube-prometheus-stack to install Loki's datasource and service monitors in the correct order
- add a Grafana dashboard for displaying and filtering the Flux controllers JSON logs
Signed-off-by: Stefan Prodan <stefan.prodan@gmail.com>
- Automate kube-prometheus-stack helm release upgrades for the v35.x range
- Remove deprecated Grafana settings
- Set Prometheus retention to 24h
- Label Flux dashboards and PodMonitors with `app.kubernetes.io/component: monitoring`
- Change the `podMonitorSelector` to match the label `app.kubernetes.io/component: monitoring`
Signed-off-by: Stefan Prodan <stefan.prodan@gmail.com>
Since kube-prometheus-stack helm chart v32.2.0, the `labelValue` has to
be set to "1" for the default grafana dashboard label selector to select
the flux dashboard configuration.
Also, update kube-prometheus-stack to v34.7.0, latest.
Refer: eba5b198f5
Signed-off-by: Sunny <darkowlzz@protonmail.com>
Something in kube-prometheus-stack 20.0.0 has broken our example.
See https://github.com/fluxcd/flux2/pull/2193 for more information.
Signed-off-by: Kingdon Barrett <kingdon@weave.works>
Edit definition of namespace variable to use grafana custom promql function `label_values`.
Rename variable namespace to operator_namespace.
Rename variable exported_namespace to namespace
Signed-off-by: Daniel AguadoAraujo <daniel.aguadoaraujo@gfk.com>
The legend was not showing the Pod name, instead the whole resource in
the dashboard
As a result, use the correct Prometheus label
Resolves:
Related:
Signed-off-by: Daniel-Andrei Minca <mandrei17@gmail.com>
Santosh Kaluskar
Arcadie Condrat
bart-plasmeijer
Stefan Prodan
Cristian Chiru
Sunny
Johannes Graf
Luke Mallon (Nalum)
Kingdon Barrett
Daniel AguadoAraujo
Paweł Krupa
Daniel-Andrei Minca
Somtochi Onyekwere
Léopold Jacquot
Hidde Beydals