Article 5 of 5
Test Report
What the run means for the decision to release.
The report turns a list of statuses into an answer: can this build go out? It shows how much was executed, what passed, what failed, and what nobody could check.
Numbers alone lie. 100% passed means nothing if only the easy third of the cases was executed, and a 90% pass rate can still be a hard no when the failing 10% is payments.
What it is made of
- Execution
- How much of the run is done: executed out of total.
- Pass rate
- Passed out of executed — not out of total; unexecuted cases are unknown, not green.
- Failures
- The failed cases with their comments — the part people actually read.
- Blocked
- The gap in your knowledge. A report with many blocked cases is not a green light.
Rules that save you later
- Report what you know and what you do not. Blocked and Not Run belong in the summary.
- A report is a snapshot: it names the build it describes.