Test ML data with faces and no CLIP embedding, and name the norm

Each backup command's tests now have a file whose ML data holds faces and no CLIP embedding; its JSON has the ML data and no keywords. The helper that gives a vector's norm is called norm. The README names what a video's JSON lacks, and the generator states its download size with the Python packages counted. Model: opus-5-5
Share clipEmbedding, and shorten the README's keyword sentences
2026-10-22 20:33:05 +00:00 · 2026-10-22 19:25:40 +00:00 · 2026-10-22 19:25:40 +00:00 · 2026-10-22 18:36:38 +00:00 · 2026-10-22 18:36:30 +00:00
1 changed files with 6 additions and 7 deletions
@@ -10,13 +10,12 @@ account into a deduplicated local directory tree, skipping files that already
 exist on disk and continuing past individual download failures instead of
 crashing. For each file it persists the basic metadata fields quak keeps (title,
 file type, creation and modification time, latitude, longitude, content hash),
-its update time, and the private and public magic metadata in full. It keeps any
-ML data Ente has for the file, except the CLIP embedding, and writes the file's
-keywords in place of the embedding. For an image (for a live photo, its image),
-it keeps its original's EXIF and XMP, with its dimensions for a JPEG only. For a
-video it keeps none of these three. It runs unattended from cron (see "Running
-the backup from cron"). A helper subcommand can detect and regenerate missing
-thumbnails, encrypting and uploading them back to the server.
+its update time, the private and public magic metadata in full, Ente's ML data
+for it when there is any, and, for an image (for a live photo, its image), its
+original's EXIF and XMP, with its dimensions for a JPEG only; for a video it
+keeps none of these three. It runs unattended from cron (see "Running the backup
+from cron"). A helper subcommand can detect and regenerate missing thumbnails,
+encrypting and uploading them back to the server.

 ## Getting Started
Author	SHA1	Message	Date
clawbot	ae003d8775	Test ML data with faces and no CLIP embedding, and name the norm check / check (push) Canceled after 0s Details Each backup command's tests now have a file whose ML data holds faces and no CLIP embedding; its JSON has the ML data and no keywords. The helper that gives a vector's norm is called norm. The README names what a video's JSON lacks, and the generator states its download size with the Python packages counted. Model: opus-5-5	2026-10-22 20:33:05 +00:00
clawbot	c65b0fae79	Share clipEmbedding, and shorten the README's keyword sentences check / check (push) Canceled after 0s Details clipKeywords takes the CLIP embedding out of a file's ML data with clipEmbedding, now exported from src/library/mldata.ts, and adds only its own checks: 512 numbers, not all zero. bin/clip-keyword-vectors puts its body in a main function called at the bottom, as the scripts under script/ do; it writes the same files. The README lists the Discover categories as bullets and states the score, the rule and the video rule in short sentences of their own. Model: opus-5-5	2026-10-22 19:25:40 +00:00
clawbot	791f17b84e	Test that a video gets no keyword from a category that leaves out videos quak backup and quak backup-metadata each get a photo and a video whose CLIP embedding is the text embedding of Identity, a Discover category that leaves out videos. The photo gets the keyword Identity and the video does not, so a command that told clipKeywords every file is a photo fails these tests. Model: opus-5-5	2026-10-22 19:25:40 +00:00
clawbot	5ec176550f	A file's JSON holds keywords in place of its CLIP embedding (closes #218 ) check / check (push) Canceled after 0s Details quak backup and quak backup-metadata write each file's ML data without its CLIP embedding, and keywords in its place: the titles of the Discover categories of Ente's photos app that the file falls in, by the app's rule. src/clip-keywords.ts applies the rule. src/clip-keyword-vectors.ts holds the 16 categories from Ente's discover.json with the text embedding Ente's CLIP text model gives each query. bin/clip-keyword-vectors writes that file and the test fixture in a digest-pinned Python image, with every download pinned by sha256; it runs by hand only. quak gains no dependency. Model: opus-5-5	2026-10-22 18:36:38 +00:00
clawbot	4863833f0a	Test keywords in place of the CLIP embedding in a file's JSON check / check (push) Canceled after 0s Details clipKeywords takes a file's ML data and whether it is a video, and gives the titles of the Discover categories of Ente's photos app that its CLIP embedding falls in, highest score first. The tests cover the rule with made-up vectors and Ente's real categories with the CLIP embedding of a public-domain photo of a sunset. The backup and backup-metadata tests now expect keywords in a file's JSON and no CLIP embedding in its mlData. These tests fail until the implementation lands. Model: opus-5-5	2026-10-22 18:36:30 +00:00