Roland d9303a0ea8 Postgres -> SQLite hard cutover: the database moves into the media directory. ... The database now lives at <media>/config/wrolpi.db so a library (files, configs, AND database) travels with the drive between WROLPi systems. Core: - wrolpi/db.py: lazy SQLite engine factory (WAL, busy_timeout=30s, foreign_keys=ON); get_db_curs yields a plain sqlite3.Cursor; native sqlite3 paramstyle everywhere (no compatibility shims); global sqlite3 adapters keep raw-SQL datetime formats identical to the ORM's. - wrolpi/fts.py: FTS5 external-content search replacing tsvector/GIN. Injection-proof websearch->FTS5 translator, bm25(10,4,2,1) reproducing A/B/C/D weighting, fast(abc)/deep column filtering, snippet headlines. Stemming contract pinned by dedicated tests (watch/watches/watched/ watching are interchangeable). - wrolpi/schema_ddl.py: SQLite triggers shared verbatim by the alembic baseline and test DBs; fixes the channel video_count DELETE/UPDATE bugs and a latent total_size bug (it used the video id as channel id). - wrolpi/db_bootstrap.py: startup auto-create/migrate; refuses databases written by a newer WROLPi (db_version_mismatch); SQLite 3.40 floor; network-filesystem refusal; never creates/migrates/trusts a database beneath an unmounted production media directory (shadow-DB guard). - Alembic: 85 Postgres-era migrations squashed into one baseline; revision ids are dates (2026_07_10_1350) so filenames self-sort and alembic_version says when a schema was created; render_as_batch=True. - All raw Postgres SQL rewritten (ANY->json_each IN, array_agg @> -> HAVING COUNT(DISTINCT), unnest->executemany/UPDATE..FROM, generate_series histograms->strftime GROUP BY, DISTINCT ON-> row_number(), writable CTEs->two statements, jsonb_*->json_*, explicit NULLS FIRST/LAST, LIMIT-before-OFFSET). Simple statements converted to SQLAlchemy instead (flag upsert, download retry/summary/tag checks, channel-by-tag estimate, Directory delete). - Config imports count skipped entries; background dumps are blocked after a lossy import so partial imports can never overwrite YAML configs (they are the sole source of truth for rebuilds now). - Search tolerates explicit JSON nulls for limit/offset (Postgres treated OFFSET NULL as 0; SQLite errors). - file_group.id/doc_section.id render as INTEGER PRIMARY KEY on SQLite (BIGINT is not a rowid alias; FTS5 content_rowid requires it). Ops teardown: docker-compose db service, CI postgres sidecars, initialize_api_db.sh, controller postgresql service, psycopg2-binary all removed. upgrade.sh stops/disables postgresql (data is NOT deleted; `systemctl enable --now postgresql` restores it); systemd units no longer Want postgresql.service. Existing-user upgrade: first boot creates+migrates the DB, configs import (tags recreate their FileGroups from disk), a refresh rebuilds the library index. QA'd on the 10.0.0.8 RPi: rebuild matched the Postgres baseline exactly; survived an uncontrolled hard reboot with clean integrity checks. Accepted behavior changes: FTS5 has no stopwords; bm25 length normalization shifts some rank orders; fast-path d_headline is un-highlighted; all-negative queries match nothing. Deferred: Debian/trixie package lists (incl. sqlite3 CLI), Cypress re-baseline, VACUUM INTO snapshots, exFAT/NTFS warning, auto-kicked rebuild refresh with progress UX. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>		2026-07-12 14:09:37 -06:00
..
__init__.py	Creating Controller service which will control WROLPi services, admin, SMART, disks, and status. nginx will fallback to Controller UI when React UI is unavailable (such as during upgrades).	2025-12-15 15:48:40 -07:00
test_admin.py	Hotspot: address review comments.	2026-07-04 09:04:17 -06:00
test_admin_api.py	Controller: move hotspot settings to controller.yaml with WiFi device dropdown.	2026-07-04 09:03:58 -06:00
test_api.py	Consolidating controller tests. Fixing controller test cleanup which slowed down tests significantly.	2026-05-15 21:10:30 -06:00
test_config.py	Migrating Controller from port 8087 to 80 so that it is more discoverable. Reformatting Controller dashboard to make header at the top. Reformatting navigation bar to handle the new links which prevented Admin from being visible in some screens.	2026-04-09 15:01:05 -06:00
test_defaults.py	Postgres -> SQLite hard cutover: the database moves into the media directory.	2026-07-12 14:09:37 -06:00
test_disks.py	Disks: allow persisting the primary mount from the UI; clean NTFS before mounting.	2026-07-05 14:50:56 -06:00
test_disks_api.py	Disks: mount the primary drive directly; clean phantom fstab.yaml entries.	2026-07-05 15:05:20 -06:00
test_docker_services.py	Replace nginx with Caddy for TLS termination and reverse proxying.	2026-03-07 18:48:44 -07:00
test_fstab.py	Disks: allow persisting the primary mount from the UI; clean NTFS before mounting.	2026-07-05 14:50:56 -06:00
test_fstab_migration.py	Moving WROLPi-managed mounts off /etc/fstab onto a drive-resident fstab.yaml.	2026-05-24 12:44:05 -06:00
test_fstab_yaml.py	Moving WROLPi-managed mounts off /etc/fstab onto a drive-resident fstab.yaml.	2026-05-24 12:44:05 -06:00
test_mount_executor.py	Reconciler: uid/gid and ntfsfix for NTFS secondary mounts.	2026-07-06 20:30:29 -06:00
test_onboarding.py	Warning users when files exist in mount location. Users may have accidentally downloaded files into the media directory, we want to warn them.	2026-05-14 17:02:52 -06:00
test_onboarding_api.py	Consolidating controller tests. Fixing controller test cleanup which slowed down tests significantly.	2026-05-15 21:10:30 -06:00
test_readiness.py	Checking readiness of main app in Controller instead of javascript requests, which break with CORS.	2026-03-08 16:05:56 -06:00
test_ready_api.py	Checking readiness of main app in Controller instead of javascript requests, which break with CORS.	2026-03-08 16:05:56 -06:00
test_reconciler.py	Reconciler: uid/gid and ntfsfix for NTFS secondary mounts.	2026-07-06 20:30:29 -06:00
test_samba.py	Adding docker support for samba shares.	2026-03-29 11:14:38 -06:00
test_samba_api.py	Adding docker support for samba shares.	2026-03-29 11:14:38 -06:00
test_schemas.py	Creating Controller service which will control WROLPi services, admin, SMART, disks, and status. nginx will fallback to Controller UI when React UI is unavailable (such as during upgrades).	2025-12-15 15:48:40 -07:00
test_scripts.py	Controller: add help.sh to the Maintenance Scripts.	2026-07-09 16:00:43 -06:00
test_scripts_api.py	Consolidating controller tests. Fixing controller test cleanup which slowed down tests significantly.	2026-05-15 21:10:30 -06:00
test_services_api.py	Consolidating controller tests. Fixing controller test cleanup which slowed down tests significantly.	2026-05-15 21:10:30 -06:00
test_smart.py	Surface coarse SMART health for USB-bridge drives (#498)	2026-06-26 09:05:06 -06:00
test_status.py	Controller tracks disk bandwidth stats.	2026-01-23 15:29:18 -07:00
test_status_api.py	Consolidating controller tests. Fixing controller test cleanup which slowed down tests significantly.	2026-05-15 21:10:30 -06:00
test_status_worker.py	Warn in the navbar when a hard drive runs hot (#470)	2026-06-11 19:46:33 -06:00
test_systemd.py	Controller: keep every wrolpi-* service visible in the UI.	2026-07-06 20:30:30 -06:00
test_wrol_mode.py	Creating Controller service which will control WROLPi services, admin, SMART, disks, and status. nginx will fallback to Controller UI when React UI is unavailable (such as during upgrades).	2025-12-15 15:48:40 -07:00