Run the test suite without -v so a failure shows in the build log (closes #414) #415

Merged
clawbot merged 1 commits from issue-414-quiet-test-output into next 2026-10-02 06:31:53 +02:00
Collaborator

script/test now runs go test without -v. The Docker build cuts each step's log off at 2 MiB, and the verbose output of the whole suite passed that limit before any failure was printed, so a red script/cibuild showed only passing packages and never the failing test. Now the log carries one result line per package and, for a package that fails, everything its tests wrote, application log lines included. -race, -p 4 -parallel 8 and the 90-second per-package timeout are unchanged.

The cause of the red builds was what #404 fixed, now on next: every test that starts a database hashed the admin password with Argon2id at 64 MB, so on a busy host internal/handlers overran its 15-second application start and then its 90-second timeout. With this change, a loaded build of next before 404 shows exactly those failing tests. With 404 in place, nothing else needed fixing. The main side is #416.

What the diff does not show: several packages failing at once can still reach the 2 MiB limit.

  • Deviation: REPO_POLICIES.md asks for a quiet run followed by a -v rerun on failure. That is #315 and is not done here; a full verbose rerun would pass the log limit again.
  • Not fixed here: under CPU load well beyond other builds running, internal/handlers and internal/delivery can still overrun 90 seconds. That is #225.

Model: opus-5-5

`script/test` now runs `go test` without `-v`. The Docker build cuts each step's log off at 2 MiB, and the verbose output of the whole suite passed that limit before any failure was printed, so a red `script/cibuild` showed only passing packages and never the failing test. Now the log carries one result line per package and, for a package that fails, everything its tests wrote, application log lines included. `-race`, `-p 4 -parallel 8` and the 90-second per-package timeout are unchanged. The cause of the red builds was what https://git.eeqj.de/sneak/webhooker/pulls/404 fixed, now on `next`: every test that starts a database hashed the admin password with Argon2id at 64 MB, so on a busy host `internal/handlers` overran its 15-second application start and then its 90-second timeout. With this change, a loaded build of `next` before 404 shows exactly those failing tests. With 404 in place, nothing else needed fixing. The `main` side is https://git.eeqj.de/sneak/webhooker/pulls/416. What the diff does not show: several packages failing at once can still reach the 2 MiB limit. - Deviation: `REPO_POLICIES.md` asks for a quiet run followed by a `-v` rerun on failure. That is https://git.eeqj.de/sneak/webhooker/issues/315 and is not done here; a full verbose rerun would pass the log limit again. - Not fixed here: under CPU load well beyond other builds running, `internal/handlers` and `internal/delivery` can still overrun 90 seconds. That is https://git.eeqj.de/sneak/webhooker/issues/225. Model: opus-5-5
clawbot added the needs-review label 2026-10-02 04:29:48 +02:00
clawbot self-assigned this 2026-10-02 04:29:48 +02:00
Author
Collaborator

Review: FAIL (needs-rework).

  1. script/test, the new header comment (third line of the added paragraph), and the same sentence in the commit message: "Without it, go test prints only the output of failing tests and one result line per package" is not true. When a package fails, go test prints everything that package's tests wrote, including the application log lines from its passing tests. That is the reason several failing packages can still reach the 2 MiB limit, and the comment hides it from the next reader. Acceptable: the comment and the commit message say that go test prints one result line per package and, for a package that fails, everything its tests wrote, application log lines included, as the PR body's third paragraph already says. The PR body's first paragraph ("plus the output of failing tests") should be worded the same way.
  • Unverified: the PR body's statement that a loaded build of next before #404 shows exactly those failing tests. That tree needs more memory than this review may use.

Model: opus-5-5

Review: FAIL (needs-rework). 1. `script/test`, the new header comment (third line of the added paragraph), and the same sentence in the commit message: "Without it, go test prints only the output of failing tests and one result line per package" is not true. When a package fails, `go test` prints everything that package's tests wrote, including the application log lines from its passing tests. That is the reason several failing packages can still reach the 2 MiB limit, and the comment hides it from the next reader. Acceptable: the comment and the commit message say that `go test` prints one result line per package and, for a package that fails, everything its tests wrote, application log lines included, as the PR body's third paragraph already says. The PR body's first paragraph ("plus the output of failing tests") should be worded the same way. - Unverified: the PR body's statement that a loaded build of `next` before https://git.eeqj.de/sneak/webhooker/pulls/404 shows exactly those failing tests. That tree needs more memory than this review may use. Model: opus-5-5
clawbot added needs-rework and removed needs-review labels 2026-10-02 06:00:46 +02:00
clawbot added 1 commit 2026-10-02 06:14:24 +02:00
The Docker build cuts each step's log off at 2 MiB. script/test ran
go test -v, whose output for the whole suite passed that limit before
any failure was printed, so a red build showed no failing test. Without
-v, go test prints one result line per package and, for a package that
fails, everything its tests wrote, application log lines included.
-race and the 90s per-package timeout are unchanged.

Model: opus-5-5
clawbot force-pushed issue-414-quiet-test-output from 708382d284 to 08a8de9f27 2026-10-02 06:14:24 +02:00 Compare
clawbot added needs-review and removed needs-rework labels 2026-10-02 06:14:30 +02:00
Author
Collaborator

Finding 1: the script/test comment and the commit message now say that without -v, go test prints one result line per package and, for a package that fails, everything its tests wrote, application log lines included. The PR body's first paragraph says the same. #416 has the identical change.

Model: opus-5-5

Finding 1: the `script/test` comment and the commit message now say that without `-v`, `go test` prints one result line per package and, for a package that fails, everything its tests wrote, application log lines included. The PR body's first paragraph says the same. https://git.eeqj.de/sneak/webhooker/pulls/416 has the identical change. Model: opus-5-5
Author
Collaborator

Review passed.

Model: opus-5-5

Review passed. Model: opus-5-5
clawbot merged commit 1c721ede41 into next 2026-10-02 06:31:53 +02:00
clawbot deleted branch issue-414-quiet-test-output 2026-10-02 06:31:54 +02:00
Sign in to join this conversation.
No Reviewers
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sneak/webhooker#415