4 Commits

Include renames

Author	SHA1	Message	Date
sneak	129c648680	ML data that does not decrypt is recorded with its reason (closes #198) ... `fetchMLDataBatch` dropped an entry that did not decrypt, gunzip or parse, so the file looked like one with no ML data and the run exited 0. It now returns the reason beside the payloads, also for ML data that is not a JSON object. The library gives the reasons from its last finished ML data fetch in `status().mlDataErrors` and the `fetchMLData` "done" event. `quak backup` writes the reason as `mlDataError` for a file with no ML data cached and records the file in `failures.json`. `backup-metadata` writes `mlDataError` for it and exits 1; `runMetadataBackup` returns `filesWithMLDataError`. Judgement call: a file whose ML data is cached keeps it in its JSON when a newer copy does not decode, as when the fetch fails. Model: opus-5-5	2026-10-16 04:16:06 +00:00
clawbot	390401af2c	Start empty when the cache directory holds another account's cache (closes #104) ... When metadata.json in the cache directory was written for a different, non-zero user ID than the client's, Library.open deletes it and mldata/ and loads an empty store, so the first refresh enumerates from 0 and none of the other account's collections, files, keys or ML results are served. Only reachable with --cache-dir or an explicit cacheDirectory. Model: opus-5-5	2026-09-23 05:56:14 +02:00
clawbot	f1836ced57	Fix two intermittently failing library tests (closes #90) ... Library.close() now returns a promise that resolves once the work it started has finished: an in-flight refresh with its cache write, the ML data fetch, and running precache sweeps. The interval test could see a refresh's new state, close, and remove the directory while the write was still running. Every library test and CLI command now awaits close(), and tests hold each of the three writes open to prove close() waits for it. The precache test waited for its stub source to be called, but the cache records a file only after checking it on disk, so status() could lag. It now waits for both fills to report "done". Model: opus-5-5	2026-09-23 04:38:00 +02:00
clawbot	d7f415fe29	Fetch, store, and index per-file ML data (closes #49) ... Adds the machine-learning (magic) data layer: fetches per-file ML payloads (face detections + CLIP embeddings) via the existing metadata-backup fetch through the metadata pool after each refresh, decrypts and gunzips them, and stores one mldata/<fileID>.json per file by rename (present-means-complete). A derived index (mldata/clip.f32 + clip.json) loads in one read and is rebuilt whenever it disagrees with the payloads on disk in either direction, so an interrupted backfill self-heals. Never in metadata.json; incremental on later refreshes; progress via onProgress/status. Model: opus-4-8	2026-09-22 17:54:40 +02:00