sneak/vaultik
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
78af626759
vaultik/internal/database
History
sneak 78af626759 Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 
This commit represents a significant architectural overhaul of vaultik:

Database Schema Changes:
- Switch files table to use UUID primary keys instead of path-based keys
- Add UUID primary keys to blobs table for immediate chunk association
- Update all foreign key relationships to use UUIDs
- Add comprehensive schema documentation in DATAMODEL.md
- Add SQLite busy timeout handling for concurrent operations

Streaming and Performance Improvements:
- Implement true streaming blob packing without intermediate storage
- Add streaming chunk processing to reduce memory usage
- Improve progress reporting with real-time metrics
- Add upload metrics tracking in new uploads table

CLI Refactoring:
- Restructure CLI to use subcommands: snapshot create/list/purge/verify
- Add store info command for S3 configuration display
- Add custom duration parser supporting days/weeks/months/years
- Remove old backup.go in favor of enhanced snapshot.go
- Add --cron flag for silent operation

Configuration Changes:
- Remove unused index_prefix configuration option
- Add support for snapshot pruning retention policies
- Improve configuration validation and error messages

Testing Improvements:
- Add comprehensive repository tests with edge cases
- Add cascade delete debugging tests
- Fix concurrent operation tests to use SQLite busy timeout
- Remove tolerance for SQLITE_BUSY errors in tests

Documentation:
- Add MIT LICENSE file
- Update README with new command structure
- Add comprehensive DATAMODEL.md explaining database schema
- Update DESIGN.md with UUID-based architecture

Other Changes:
- Add test-config.yml for testing
- Update Makefile with better test output formatting
- Fix various race conditions in concurrent operations
- Improve error handling throughout
2025-07-22 14:56:44 +02:00
..
schema Refactor blob storage to use UUID primary keys and implement streaming chunking 2025-07-22 07:43:39 +02:00
blob_chunks_test.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
blob_chunks.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
blobs_test.go Refactor blob storage to use UUID primary keys and implement streaming chunking 2025-07-22 07:43:39 +02:00
blobs.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
cascade_debug_test.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
chunk_files_test.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
chunk_files.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
chunks_ext.go Move StartTime initialization to application startup hook 2025-07-20 12:05:24 +02:00
chunks_test.go Implement SQLite index database layer 2025-07-20 10:56:30 +02:00
chunks.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
database_test.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
database.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
errors.go Implement local SQLite index database with repositories 2025-07-20 10:26:15 +02:00
file_chunks_test.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
file_chunks.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
files_test.go Implement SQLite index database layer 2025-07-20 10:56:30 +02:00
files.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
models.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
module.go Refactor blob storage to use UUID primary keys and implement streaming chunking 2025-07-22 07:43:39 +02:00
repositories_test.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
repositories.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
repository_comprehensive_test.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
repository_debug_test.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
repository_edge_cases_test.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
schema.sql Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
snapshots_test.go Refactor blob storage to use UUID primary keys and implement streaming chunking 2025-07-22 07:43:39 +02:00
snapshots.go Major refactoring: UUID-based storage, streaming architecture, and CLI improvements 2025-07-22 14:56:44 +02:00
uploads.go Refactor blob storage to use UUID primary keys and implement streaming chunking 2025-07-22 07:43:39 +02:00