6 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
clawbot	3fd8ea8990	Say what the content phase's check does to a stale record ... The README content phase item and the contentCandidates comment said a file failing the check is not a duplicate. It keeps its record and does not count as a match; with a content hash it is still reported until a scan covering its tree updates or removes it. Model: opus-5-5	2026-09-23 13:51:07 +00:00
clawbot	fff4409a24	Check every group member and show the content phase from its start ... The content phase now checks every record sharing a size, head and tail with lstat, including those that already have a content hash, and reads those without one only when at least two pass. Only a missing file is passed over silently; any other lstat error is warned about and counted as skipped. The phase shows a running count while it queries and checks, then its bar. The README states once when content is empty. New tests cover these and hard links. Model: opus-5-5	2026-09-23 13:09:03 +00:00
clawbot	89fc9e4595	Compute the content hash only when head and tail match (closes #61) ... A file of 10 MiB or more now gets only its head and tail in the hash phase. A new content phase, after the update phase, finds every record of that size without a content hash whose size, head and tail match another record's, anywhere in the database, checks each file with lstat, and reads a group only while at least two members remain. It reuses the hash worker pool, now given its hash function. report and trees leave out records without a content hash. The README, help text and TODO entry describe the gate; the schema stays at version 1. Model: opus-5-5	2026-09-23 12:18:39 +00:00
clawbot	09a39ddf37	Keep the database schema at version 1 (closes #61) ... sfdupes is pre-1.0, with no installed base and no databases anywhere, so the schema is changed in place and its version stays 1. schemaVersion goes back to 1; the six-column files table, content included, is the version 1 schema. The check that stops on a database with any other version stays. README.md and TODO.md no longer describe a version 2 or rejecting and rescanning version 1 databases. The main.go package comment still described 1024-byte end windows and said full file contents are never read; it now describes the hashes the code computes. Model: opus-5-5	2026-09-23 13:38:06 +02:00
clawbot	29a65016d0	Add 64 KiB head/tail and content-hash duplicate ladder (closes #61) (#62)	2026-09-22 16:40:43 +02:00
clawbot	7ac4f6b723	Remove dead files.dat references from build config (closes #22) ... files.dat was the scan format before the SQLite database; nothing has produced it since. Drop the stale references from the Makefile clean target, .gitignore and .dockerignore. make clean still removes the binary and .gitignore still covers the database files. The only remaining mention is the historical entry in TODO.md. Model: opus-4-8 (implementation); fable-5-1 (merge)	2026-09-21 15:01:57 +02:00