E02 · Evidence

Reproducible verification

A result depends on an undocumented setup or a reviewer’s intuition.

Requirement

Record preconditions, inputs, procedure, expected result, observed result and evaluator so another qualified reviewer can repeat the test.

Expected evidence

  • Executable test cases or precise protocols.
  • Environment manifest and retained result files.

Proposed verification

  1. Have a second reviewer repeat a risk-based sample.
  2. Investigate and record material differences.

Limit

Stochastic systems may not reproduce identically; tolerances and repetition counts must be stated.

Sources