Thanos Rule Rule Evaluation Latency High warning
Thanos Rule {{$labels.instance}} has higher evaluation latency than interval for {{$labels.rule_group}}.
>>>
(sum by (job, instance, rule_group) (
{job=~".*thanos-rule.*"}) > sum by (job, instance, rule_group) (
{job=~".*thanos-rule.*"}))
The query aggregates the latest execution time of each Thanos rule (prometheus_rule_group_last_duration_seconds) and the rule’s configured interval (prometheus_rule_group_interval_seconds) by job, instance and rule_group; it then checks whether the execution time is greater than the interval. The alert fires when a rule’s evaluation latency exceeds its scheduled interval, meaning the rule cannot keep up with its desired scrape cadence.
Get Alert✕
Download
Copy to Clipboard