A check that is declared but never exercised by a case shows as untested — a real gap, not just a missing checklist item.
What the test suite contains
- Expected cases — clean examples based on real records where available.
- Difficult cases — partial data, new items, mismatches, duplicates, and other exceptions.
- Pass-or-fail rules — how each result is judged.
- Blocked risky actions — tests for every tool that can change data or take action.
- Minimum pilot score — the pass rate required before the pilot can begin.
Offline test results
| Result | What it means |
|---|---|
| Passed | Every runnable case passed and the minimum score was met |
| Failed | The tests ran, but the pass rate was too low |
| Blocked | The tests had no runnable cases or an integration stand-in was not ready |
| Unsafe to run | A risky action has not been covered by a real test case |