SEV-3

Inventory API

Increased 5xx Responses

inventory-service

MonitoringStarted 10:42

Scripted investigation is on the checkout-api SEV-1.

0.9%Errors

160msp95

12.4k/minreq/min

2%Impact

Metrics

error_rate

Current error rate 0.3%. Peak 2.4%.

p95_latency

Current p95 134ms. Peak 152ms.

request_rate

Current request rate 12.5k/min. Peak 12.6k/min.

showing 12 of 12

Time	Duration	Status
14:14:44	65ms	OK
13:38:44	53ms	OK
13:15:01	43ms	OK
13:14:37	112ms	OK
13:11:23	56ms	OK
13:06:25	50ms	OK
13:05:47	61ms	OK
12:56:52	70ms	ERROR
12:45:53	40ms	OK
12:40:13	45ms	OK
12:03:32	70ms	OK
12:02:16	101ms	OK

Select a trace to open the waterfall.

showing 13 of 13

14:14:44.151INFO
POST /reserve ok duration=65ms
inventory-service · · 462f9a514782
13:38:44.709INFO
POST /reserve ok duration=53ms
inventory-service · · 8eed72a60e80
13:15:01.996INFO
POST /reserve ok duration=43ms
inventory-service · · 99a9e5398d55
13:14:37.213INFO
POST /reserve ok duration=112ms
inventory-service · · af5a98a4a5d6
13:11:23.299INFO
POST /reserve ok duration=56ms
inventory-service · · edaf5d433eab
13:06:25.317INFO
POST /reserve ok duration=50ms
inventory-service · · 89e8ff4943a6
13:05:47.332INFO
POST /reserve ok duration=61ms
inventory-service · · 2c6c225675ee
12:56:52.613ERROR
upstream request failed
inventory-service · · a9b6d7bda906
12:56:52.609ERROR
POST /reserve failed duration=70ms
inventory-service · · a9b6d7bda906
12:45:53.571INFO
POST /reserve ok duration=40ms
inventory-service · · 6e31c87ab087
12:40:13.901INFO
POST /reserve ok duration=45ms
inventory-service · · 2ebee60fe7ea
12:03:32.758INFO
POST /reserve ok duration=70ms
inventory-service · · f9b4e657c5aa
12:02:16.906INFO
POST /reserve ok duration=101ms
inventory-service · · ca4b49bfe4df

Version	Time	Commit	Change
v2.4	yesterday 07:40	a30ff3	Warehouse reservation lock tweak
v2.3	3d ago 18:19	16b196	SKU cache warmer
v2.2	8d ago 11:51	102ecb	Backorder flag propagation
v2.1	11d ago 14:06	572c92	Read replica routing

frontenderr 0.2% · p95 90ms

Healthy

checkout-apierr 18.4% · p95 2.8s

Critical

payment-serviceerr 0.4% · p95 380ms

Degraded

inventory-serviceerr 0.9% · p95 160ms

Degraded

user-serviceerr 0.1% · p95 70ms

Healthy

checkout-dbdependency of checkout-api

Healthy

frontend depends on checkout-api, which calls payment-service, inventory-service, and user-service. Database is shown as a checkout-api dependency.