TestFlow

Article 5 of 5

Test Report

What the run means for the decision to release.

The report turns a list of statuses into an answer: can this build go out? It shows how much was executed, what passed, what failed, and what nobody could check.

Numbers alone lie. 100% passed means nothing if only the easy third of the cases was executed, and a 90% pass rate can still be a hard no when the failing 10% is payments.

What it is made of

Execution
How much of the run is done: executed out of total.
Pass rate
Passed out of executed — not out of total; unexecuted cases are unknown, not green.
Failures
The failed cases with their comments — the part people actually read.
Blocked
The gap in your knowledge. A report with many blocked cases is not a green light.

Rules that save you later

  • Report what you know and what you do not. Blocked and Not Run belong in the summary.
  • A report is a snapshot: it names the build it describes.