Full test suite: failures and errors

Failures are recorded, not skipped. The count rises when new tests land faster than fixes, and part of each reading was later traced to worktree-only artefacts.

Full test suite: failures and errors

Then 146 tests 16 Aug 2026 Now 311 tests 17 Sept 2026 worse

  • measured or observed
Show the numbers
Full test suite: failures and errors
Date Value Evidence Revision Samples Note
16 Aug 2026 146 tests MEASURED 5d76fa7f9 10162 146 failing/erroring tests were recorded honestly on 2026-08-16 rather than skipped.
20 Aug 2026 132 tests MEASURED 0486a5c89 10971 132 failing/erroring tests were recorded honestly on 2026-08-20 rather than skipped.
29 Aug 2026 52 tests MEASURED 926366a98 14648 52 failing/erroring tests were recorded honestly on 2026-08-29 rather than skipped.
1 Sept 2026 92 tests MEASURED e1d230e6f 15569 92 failing/erroring tests were recorded honestly on 2026-09-01 rather than skipped.
6 Sept 2026 137 tests MEASURED 47b98385c 16874 137 failing/erroring tests were recorded honestly on 2026-09-06 rather than skipped.
9 Sept 2026 2 tests MEASURED 4aaaaeafa 20634 2 failing/erroring tests were recorded honestly on 2026-09-09 rather than skipped.
13 Sept 2026 192 tests MEASURED bdf9bf490 21520 192 failing/erroring tests were recorded honestly on 2026-09-13 rather than skipped.
17 Sept 2026 311 tests MEASURED bb54722e0 23984 311 failing/erroring tests were recorded honestly on 2026-09-17 rather than skipped.

Failures are recorded, not skipped. The count rises when new tests land faster than fixes, and part of each reading was later traced to worktree-only artefacts.

Test: Same run: failed tests plus collection/setup errors (107 failed, 39 errors) of 10162 collected.

Protocol

Test definition

Same run: failed tests plus collection/setup errors (107 failed, 39 errors) of 10162 collected.

Limits

Limitations

  • Failures are preserved rather than skipped; increases often reflect newly added stricter tests or evidence ageing, not only regressions.

Log

Recorded values

Date Value Evidence Samples Source
16 August 2026 146 tests MEASURED 10162 docs/ledger/SUITE_RESULT.json @ c6dd35b55
20 August 2026 132 tests MEASURED 10971 docs/ledger/SUITE_RESULT.json @ f11b56003
29 August 2026 52 tests MEASURED 14648 docs/ledger/SUITE_RESULT.json @ 7ce8978aa
1 September 2026 92 tests MEASURED 15569 docs/ledger/SUITE_RESULT.json @ d87991adf
6 September 2026 137 tests MEASURED 16874 docs/ledger/SUITE_RESULT.json @ b9069f1d7
9 September 2026 2 tests MEASURED 20634 docs/ledger/SUITE_RESULT.json @ 56b23ad45
13 September 2026 192 tests MEASURED 21520 docs/ledger/SUITE_RESULT.json @ b75f4912c
17 September 2026 311 tests MEASURED 23984 docs/ledger/SUITE_RESULT.json @ cec1be303

Source paths refer to the private JARVIS repository and runtime records. They are listed for audit and are not published.