Test plans on a board: suites, cases, runs, defects.

Requirements, suites and cases drawn as objects, and a run as a column of results — so a red result points at the case, the requirement and the defect.

lantern coffee · pre-order 1.0 · test run
REQUIREMENT · REQ-4Pay at pickup
TEST SUITE · CHECKOUT
TC-11Pay at pickup, signed in
TC-12Pay at pickup, as a guest
TC-13Pay at pickup, offline
TC-14Cancel before pickup
RUN 3 · OCT 14
Passed
Passed
Failed
Blocked
DEFECT · PRE-21 · found by TC-13Pay button stays disabled offline
ENVIRONMENTiPhone · SoHo Wi-Fi

A run is a column of results.

A spreadsheet of test cases answers "did it pass". On the board each run is a column of results beside the cases, so three runs side by side show what got better, what broke and what never ran — without copying the case list again.

Every testing figure, named ↓

lantern coffee · pre-order 1.0 · checkout runs
RUN 1RUN 2RUN 3
TC-11Pay at pickup, signed in
FailedPassedPassed
TC-12Pay at pickup, as a guest
SkippedPassedPassed
TC-13Pay at pickup, offline
PassedPassedFailed
TC-14Cancel before pickup
BlockedBlockedBlocked

Coverage is a relation, not a column.

A case is joined by relations to the requirement it covers, the suite it belongs to and the defect it found. Start from a red result and follow it: the case, the requirement it was meant to prove, the defect that is open — on this board or on any other that draws them.

Read more: One object, many boards →

lantern coffee · pre-order 1.0 · coverage
REQ-4Pay at pickup
covered by
TC-13Pay at pickup, offline
result in Run 3
Failed
found
PRE-21Pay button stays disabled offline

An outcome is one of four.

A result is the object of a pair: the run and the case it is a result of. Its outcome is a choice from a fixed list — Passed, Failed, Blocked, Skipped — and the result figure takes its colour from it, so nobody invents a fifth word in the middle of a release.

Read more: Fields: typed in or counted →

lantern coffee · objects · tc-13 in run 3
TC-13 · Run 3Test result
runRun 3 ›
caseTC-13 ›
environmentiPhone · SoHo Wi-Fi ›
outcomePassedFailedBlockedSkipped
the figure
Failedcolour ← outcome

Every figure, named.

The toolbar's own names — what you pick is what this list says: two groups, 14 figures.

QA & Testing8

Reading the run6