Promhub Logo Prom hub

Thanos Query Http Request Query Range Error Rate High
critical

Description Thanos Query {{$labels.job}} is failing to handle {{$value | humanize}}% of "query_range" requests.
Query for 5m 
>>>
	
				
					(sum by (job) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{code=~"5..", job=~".*thanos-query.*", handler="query_range"}[5m]))/  sum by (job) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{job=~".*thanos-query.*", handler="query_range"}[5m]))) * 100 > 5
Query Explanation

The rule calculates, for each Thanos Query job, the percentage of query_range HTTP requests that returned 5xx status codes over the past 5 minutes (error rate = rate of 5xx requests ÷ total request rate × 100). The alert triggers when this error percentage exceeds 5 % for any Thanos Query instance.

Get Alert✕
Download
Copy to Clipboard