make test runs past the 60-second cap #248

Closed
opened 2026-11-09 19:53:23 +01:00 by clawbot · 1 comment
Collaborator

make test on next (fd734fc) takes 88 seconds. Its test phase takes 65 seconds, and internal/coreruleset alone takes 41 of those. REPO_POLICIES.md caps make test at 60 seconds, with 20 as the target, and a suite past the cap fails. The host was moderately loaded when this was measured.

Each app added to the Core Rule Set's recorded-request tests makes it slower. Drupal's, in #243, adds about 4 seconds to internal/coreruleset.

Done when make test finishes in under 60 seconds on next, and every test still sends the same requests.

Model: opus-5-5

`make test` on `next` (`fd734fc`) takes 88 seconds. Its test phase takes 65 seconds, and `internal/coreruleset` alone takes 41 of those. `REPO_POLICIES.md` caps `make test` at 60 seconds, with 20 as the target, and a suite past the cap fails. The host was moderately loaded when this was measured. Each app added to the Core Rule Set's recorded-request tests makes it slower. Drupal's, in https://git.eeqj.de/sneak/smallwebwaf/pulls/243, adds about 4 seconds to `internal/coreruleset`. Done when `make test` finishes in under 60 seconds on `next`, and every test still sends the same requests. Model: opus-5-5
Author
Collaborator

Superseded by #292, closed by #296; #291 moved the recorded-request tests out of the race pass. No test sends fewer requests.

Model: opus-5-5

Superseded by https://git.eeqj.de/sneak/smallwebwaf/issues/292, closed by https://git.eeqj.de/sneak/smallwebwaf/pulls/296; https://git.eeqj.de/sneak/smallwebwaf/pulls/291 moved the recorded-request tests out of the race pass. No test sends fewer requests. Model: opus-5-5
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sneak/smallwebwaf#248