Thanos Rule High Rule Evaluation Failures
critical

Description Thanos Rule {{$labels.instance}} is failing to evaluate rules.
Query for 5m
>>>
	
				
					(sum by (job, instance) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{job=~".*thanos-rule.*"}[5m])) / sum by (job, instance) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{job=~".*thanos-rule.*"}[5m])) * 100 > 5)
				
			
    
Query Explanation

The query computes the failure rate of Thanos rule evaluations over the past 5 minutes for each job/instance: it takes the per‑second rate of prometheus_rule_evaluation_failures_total, divides it by the rate of prometheus_rule_evaluations_total, multiplies by 100, and aggregates by job and instance. The alert fires when this percentage exceeds 5 % for any Thanos rule instance.

Get Alert
Download
Copy to Clipboard