added alerts to cortex (#240)

* added alerts to cortex

* Update rules.yml

Co-authored-by: apmbktf <andre.pasqualinoto-martins@itau-unibanco.com.br>
Co-authored-by: Samuel Berthe <dev@samuel-berthe.fr>
This commit is contained in:
Andre Martins 2021-08-19 15:31:46 -03:00 committed by GitHub
parent 7304d40539
commit b47359c2fd
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23

View file

@ -2027,3 +2027,12 @@ groups:
description: Cortex is failing when sengin alert notifications (instance {{ $labels.instance }})
query: rate(cortex_prometheus_notifications_errors_total[5m]) > 0
severity: critical
- name: Cortex ingester unhealthy
description: Cortex has an unhealthy ingester
query: cortex_ring_members{state="Unhealthy", name="ingester"} > 0
severity: critical
- name: Cortex frontend queries stuck
description: There are queued up queries in query-frontend.
query: sum by (job) (cortex_query_frontend_queue_length) > 0
severity: critical
for: 5m