Reliability
What the last run measured.
We publish the numbers because most tools in this category do not. Every figure below comes from running 34 agent scenarios against the deployed servers, including the failure cases.
100%scenarios passed
34/34scenario results
1of those degraded upstream
5.54sslowest p95 across servers
16 Augmeasured 22:37 UTC
verifydesk
| Tool | Scenarios | Passed | p95 |
|---|---|---|---|
| verify_company | 4 | 100% | 1.02s |
| verify_vat | 2 | 100% | 888ms |
| validate_iban | 4 | 100% | 723ms |
| screen_sanctions | 3 | 100% | 651ms |
| enrich_company | 2 | 100% | 780ms |
| get_usage | 1 | 100% | 589ms |
jobsradar
| Tool | Scenarios | Passed | p95 |
|---|---|---|---|
| list_supported_companies | 2 | 100% | 1.88s |
| search_jobs | 3 | 100% | 5.54s |
| get_company_jobs | 3 | 100% | 1.95s |
| get_usage | 1 | 100% | 590ms |
invoiceforge
| Tool | Scenarios | Passed | p95 |
|---|---|---|---|
| generate_invoice | 3 | 100% | 1.02s |
| validate_invoice | 2 | 100% | 636ms |
| extract_invoice | 2 | 100% | 624ms |
| describe_coverage | 1 | 100% | 635ms |
| get_usage | 1 | 100% | 587ms |
How this is measured
- The suite runs real calls against the deployed endpoint, not a mock: registry lookups, VAT checks, IBAN validation, sanctions screening.
- A scenario passes only if the answer is usable by an agent: right shape, no leaked internals, and errors that say what to do next.
- Failure cases count. Unknown companies, malformed input and unsupported countries are part of the run, because that is where tools usually break.
- p95 is the slowest response in the top 5 percent, measured end to end from outside Cloudflare, so it includes the upstream registries and job boards. Searching many job boards at once means the slowest board sets the number, and it moves between runs.
- Some sources throttle or go down without warning: the European VAT service does it regularly. When that happens the scenario is marked degraded upstream and still counts as met, because what we promise in that case is to fail well: a clean, actionable, retryable error rather than a break or a wrong answer. It is counted separately and shown in its own figure above, so a run where an upstream was down never reads as a run where everything worked. If the tool had broken or leaked internals instead, it would count as our failure.
This page shows the most recent published run rather than a rolling uptime average. Continuous monitoring is not running yet, so read this as a dated measurement rather than as live uptime. We would rather publish one honest run than an average we do not actually compute.