Roland b810ab2fc0 Archives: an unpaired-surrogate title must not kill the modeler. ... Scraped pages can carry half an emoji in their titles; sqlite3 refuses to store lone surrogates, so one poisoned title failed archive_modeler's batch commit and ended the whole modeling run on 10.0.0.9. Every archive after it stayed unmodeled, and cleanup then deleted their 'empty' domain collections (1,670 -> 578). Strip surrogates at every point Archive ingests scraped strings (titles, author, description, url, article text), and make the modeler skip a batch whose commit fails instead of dying. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>		2026-07-13 19:25:30 -06:00
..
__init__.py	A new start	2021-11-01 16:43:09 -06:00
test_api.py	Postgres -> SQLite hard cutover: the database moves into the media directory.	2026-07-12 14:09:37 -06:00
test_archive_downloader.py	Single file deno (#478)	2026-06-12 17:07:28 -06:00
test_archive_modeler_loop.py	Archives: an unpaired-surrogate title must not kill the modeler.	2026-07-13 19:25:30 -06:00
test_collection_id_bug.py	Updating archive downloader to use download.destination.	2025-12-17 16:56:58 -07:00
test_compressed_singlefile.py	HTML indexer is binary-safe; it indexes the page inside a compressed singlefile.	2026-06-12 17:24:02 -06:00
test_config_import_scenarios.py	Detecting collection directories using collection formatting rather than relying on parent directory of file groups, because those are now longer always in the collection directory.	2026-02-07 17:16:08 -07:00
test_domain_tagging.py	Fixing bug where configs could be overwritten with empty configs on first refresh. Fixing bug where configs were displayed as JSON in admin settings.	2026-03-22 12:56:37 -06:00
test_domains_config.py	Testing that nearly-empty configs are ignored on import. Adding setting to disable automatic upgrade checking.	2025-12-06 15:11:37 -07:00
test_lib.py	Postgres -> SQLite hard cutover: the database moves into the media directory.	2026-07-12 14:09:37 -06:00
test_models.py	Storing parent_download_url in a file group's json file after download has completed.	2026-03-03 15:54:22 -07:00