Accuracy
The agent measured: 7 replayed days, Sat to Fri. Measured against 252 injected incidents (incidents_truth) between the agent's first and last tick, Sat 19:00 to Fri 22:59 CEST, 7 replayed days. Incidents from before it was switched on are not counted. A detection matches a planted incident of a kind it reports, on the same store, merchant or integration, within 20 minutes.Precision0.997856 detections
Recall0.988of 252 injected
Resolved automatically96.9%auto rate, 7-day mean
Reverted by people0actions a person undid
Cost per resolved incidentEUR 0.00687 resolved · EUR 0.00 model spend
Time to resolve20 smean, all resolved · stuck orders to the re-send 45 s · 36 min 19 s when a person decides
Precision per detector, per day
the 6 busiest detectors; the rest are in the table belowReverted actions
who undid the agent, and why| When (CEST) | Store | Kind and call | By | Why | |
|---|---|---|---|---|---|
| No reverts in this window. | |||||
Drift alarms
precision down 15 pts week on week| Fri | green | all detectors | Week-on-week alarms need 14 replayed days; the ledger has 7. waiting for data |
| Fri | green | model | No drift: answers usable, confidence steady, few reverts. recal.drift |
Per detector, 7 days
precision: of what it flagged, how much was a planted incident| Detector | Detections | Precision | Reports |
|---|---|---|---|
| acceptance_risk | 14 | 0.857 | acceptance_risk |
| aggregator_outage | 2 | 1.000 | aggregator_outage |
| churn_risk | 33 | 1.000 | churn_signal |
| courier_no_show | 59 | 1.000 | courier_no_show |
| duplicate_order | 330 | 1.000 | duplicate_orders |
| failing_integration | 36 | 0.972 | integration_version_regression, pos_auth_expired |
| menu_drift | 18 | 1.000 | menu_sync_drift |
| offline_printer | 29 | 1.000 | printer_offline |
| overdue_invoice | 37 | 1.000 | invoice_overdue_45 |
| overloaded_branch | 75 | 1.000 | branch_overload |
| pos_link_down | 196 | 1.000 | pos_auth_expired |
| pos_token_expiring | 14 | 1.000 | pos_token_expiring |
| release_regression | 1 | 1.000 | integration_version_regression |
| stuck_order | 12 | 1.000 | pos_auth_expired |
Planted incidents, by kind
recall: of what was planted, how much it found; the counts add up to 252| Planted kind | Planted | Found | Recall | Reported by |
|---|---|---|---|---|
| courier_no_show | 59 | 59 | 1.000 | courier_no_show |
| branch_overload | 39 | 39 | 1.000 | overloaded_branch |
| invoice_overdue_45 | 37 | 37 | 1.000 | overdue_invoice |
| churn_signal | 35 | 33 | 0.943 | churn_risk |
| pos_auth_expired | 20 | 19 | 0.950 | failing_integration, pos_link_down, stuck_order |
| menu_sync_drift | 18 | 18 | 1.000 | menu_drift |
| pos_token_expiring | 14 | 14 | 1.000 | pos_token_expiring |
| printer_offline | 14 | 14 | 1.000 | offline_printer |
| acceptance_risk | 12 | 12 | 1.000 | acceptance_risk |
| aggregator_outage | 2 | 2 | 1.000 | aggregator_outage |
| duplicate_orders | 1 | 1 | 1.000 | duplicate_order |
| integration_version_regression | 1 | 1 | 1.000 | failing_integration, release_regression |
| total | 252 | 249 | 0.988 |