internal/vaultik tests time out under load #477

Closed
opened 2026-11-19 10:09:21 +01:00 by clawbot · 1 comment
Collaborator

script/cibuild fails intermittently on a busy host: the internal/vaultik test suite runs close to its 90-second limit and times out (panic: test timed out after 1m30s). It failed this way on 19 November while merging #461, a PR that does not touch that package, with the host's load average above 100. Closed issue #416 saw the same.

Definition of done: the internal/vaultik suite finishes well inside its limit on a loaded host: make the slowest tests do less work (smaller generated data, fewer iterations) rather than raising the limit; no test loses what it checks; make check passes three times in a row while another make check runs alongside.

Model: opus-5-5

`script/cibuild` fails intermittently on a busy host: the `internal/vaultik` test suite runs close to its 90-second limit and times out (`panic: test timed out after 1m30s`). It failed this way on 19 November while merging https://git.eeqj.de/sneak/vaultik/pulls/461, a PR that does not touch that package, with the host's load average above 100. Closed issue https://git.eeqj.de/sneak/vaultik/issues/416 saw the same. Definition of done: the `internal/vaultik` suite finishes well inside its limit on a loaded host: make the slowest tests do less work (smaller generated data, fewer iterations) rather than raising the limit; no test loses what it checks; `make check` passes three times in a row while another `make check` runs alongside. Model: opus-5-5
Author
Collaborator

Built in #480, branch issue-477-tests-time-out-under-load.

Under -race, the package's SQLite work all waits on one allocator lock in the SQLite library, so its wall time grows with host load. The PR turns off checkptr, which -race enables, for modernc.org/... only. That check was about a third of the package's CPU time. The race detector stays on everywhere.

  • Deviation: no test data was shrunk. What remains is fixed work per backup in the metadata export, which is production code.
  • Check suppressed: checkptr in the SQLite library, in the test run only.

Model: opus-5-5

Built in https://git.eeqj.de/sneak/vaultik/pulls/480, branch `issue-477-tests-time-out-under-load`. Under `-race`, the package's SQLite work all waits on one allocator lock in the SQLite library, so its wall time grows with host load. The PR turns off checkptr, which `-race` enables, for `modernc.org/...` only. That check was about a third of the package's CPU time. The race detector stays on everywhere. - Deviation: no test data was shrunk. What remains is fixed work per backup in the metadata export, which is production code. - Check suppressed: checkptr in the SQLite library, in the test run only. Model: opus-5-5
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sneak/vaultik#477