quoteIfNeeded leaves invalid UTF-8 bare, so raw invalid bytes reach the terminal #24

New Issue

clawbot · 2026-08-10T15:36:50+02:00

clawbot commented

2026-08-10 15:36:50 +02:00

Found reviewing #21
(#21 (comment)). Pre-existing
for values; that PR extended quoteIfNeeded to keys, which is how it surfaced.

quoteIfNeeded quotes on delimiter ambiguity, and unicode.IsPrint treats
U+FFFD as printable, so a string containing an invalid UTF-8 byte stays bare.
Console output is bad\xffkey=v where slog.NewTextHandler emits
"bad\xffkey"=v.

The consequence is not parse ambiguity — bad\xffkey=v still splits correctly —
but that a raw invalid byte reaches the terminal and any UTF-8-strict consumer.

Definition of done

Invalid UTF-8 is quoted rather than emitted raw, matching
slog.NewTextHandler.
Applied consistently to keys and values: quoteIfNeeded serves both, so a
fix to one changes the other. A differential against slog.NewTextHandler
covering both is the evidence.
Valid non-ASCII stays unquoted where stdlib leaves it unquoted — do not fix
this by quoting everything non-ASCII.

Implementation requirements

Do not change WithGroup("") behaviour; its divergence from
slog.NewJSONHandler is deliberate and was confirmed twice.
Landing commit title must end with (closes #24).

Found reviewing https://git.eeqj.de/sneak/simplelog/pulls/21 (https://git.eeqj.de/sneak/simplelog/pulls/21#issuecomment-54029). Pre-existing for values; that PR extended `quoteIfNeeded` to keys, which is how it surfaced. `quoteIfNeeded` quotes on delimiter ambiguity, and `unicode.IsPrint` treats U+FFFD as printable, so a string containing an invalid UTF-8 byte stays bare. Console output is `bad\xffkey=v` where `slog.NewTextHandler` emits `"bad\xffkey"=v`. The consequence is not parse ambiguity — `bad\xffkey=v` still splits correctly — but that a raw invalid byte reaches the terminal and any UTF-8-strict consumer. ## Definition of done - Invalid UTF-8 is quoted rather than emitted raw, matching `slog.NewTextHandler`. - Applied consistently to keys **and** values: `quoteIfNeeded` serves both, so a fix to one changes the other. A differential against `slog.NewTextHandler` covering both is the evidence. - Valid non-ASCII stays unquoted where stdlib leaves it unquoted — do not fix this by quoting everything non-ASCII. ## Implementation requirements - Do not change `WithGroup("")` behaviour; its divergence from `slog.NewJSONHandler` is deliberate and was confirmed twice. - Landing commit title must end with ` (closes #24)`.

clawbot referenced this issue

2026-08-10 15:36:57 +02:00

Emit slog attributes from every handler #21

clawbot referenced this issue

2026-08-10 15:37:26 +02:00

Emit slog attributes from every handler #21

sneak commented

2026-08-10 15:38:56 +02:00

work this into 21

sneak closed this issue

2026-08-10 15:39:04 +02:00

Sign in to join this conversation.