Roland d9303a0ea8 Postgres -> SQLite hard cutover: the database moves into the media directory. ... The database now lives at <media>/config/wrolpi.db so a library (files, configs, AND database) travels with the drive between WROLPi systems. Core: - wrolpi/db.py: lazy SQLite engine factory (WAL, busy_timeout=30s, foreign_keys=ON); get_db_curs yields a plain sqlite3.Cursor; native sqlite3 paramstyle everywhere (no compatibility shims); global sqlite3 adapters keep raw-SQL datetime formats identical to the ORM's. - wrolpi/fts.py: FTS5 external-content search replacing tsvector/GIN. Injection-proof websearch->FTS5 translator, bm25(10,4,2,1) reproducing A/B/C/D weighting, fast(abc)/deep column filtering, snippet headlines. Stemming contract pinned by dedicated tests (watch/watches/watched/ watching are interchangeable). - wrolpi/schema_ddl.py: SQLite triggers shared verbatim by the alembic baseline and test DBs; fixes the channel video_count DELETE/UPDATE bugs and a latent total_size bug (it used the video id as channel id). - wrolpi/db_bootstrap.py: startup auto-create/migrate; refuses databases written by a newer WROLPi (db_version_mismatch); SQLite 3.40 floor; network-filesystem refusal; never creates/migrates/trusts a database beneath an unmounted production media directory (shadow-DB guard). - Alembic: 85 Postgres-era migrations squashed into one baseline; revision ids are dates (2026_07_10_1350) so filenames self-sort and alembic_version says when a schema was created; render_as_batch=True. - All raw Postgres SQL rewritten (ANY->json_each IN, array_agg @> -> HAVING COUNT(DISTINCT), unnest->executemany/UPDATE..FROM, generate_series histograms->strftime GROUP BY, DISTINCT ON-> row_number(), writable CTEs->two statements, jsonb_*->json_*, explicit NULLS FIRST/LAST, LIMIT-before-OFFSET). Simple statements converted to SQLAlchemy instead (flag upsert, download retry/summary/tag checks, channel-by-tag estimate, Directory delete). - Config imports count skipped entries; background dumps are blocked after a lossy import so partial imports can never overwrite YAML configs (they are the sole source of truth for rebuilds now). - Search tolerates explicit JSON nulls for limit/offset (Postgres treated OFFSET NULL as 0; SQLite errors). - file_group.id/doc_section.id render as INTEGER PRIMARY KEY on SQLite (BIGINT is not a rowid alias; FTS5 content_rowid requires it). Ops teardown: docker-compose db service, CI postgres sidecars, initialize_api_db.sh, controller postgresql service, psycopg2-binary all removed. upgrade.sh stops/disables postgresql (data is NOT deleted; `systemctl enable --now postgresql` restores it); systemd units no longer Want postgresql.service. Existing-user upgrade: first boot creates+migrates the DB, configs import (tags recreate their FileGroups from disk), a refresh rebuilds the library index. QA'd on the 10.0.0.8 RPi: rebuild matched the Postgres baseline exactly; survived an uncontrolled hard reboot with clean integrity checks. Accepted behavior changes: FTS5 has no stopwords; bm25 length normalization shifts some rank orders; fast-path d_headline is un-highlighted; all-negative queries match nothing. Deferred: Debian/trixie package lists (incl. sqlite3 CLI), Cypress re-baseline, VACUUM INTO snapshots, exFAT/NTFS warning, auto-kicked rebuild refresh with progress UX. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>		2026-07-12 14:09:37 -06:00
..
cleanup_orphaned_tags.py	Creating script to clean up orphaned tag files.	2026-02-28 17:05:02 -07:00
delete_downloads.py	Many fixes split out from the feature/unified-query branch. Installing diagnostic tools in the built images. Displaying video comment statistics. Echoing error when install.sh fails.	2024-04-14 13:13:30 -06:00
delete_similarly_named_videos.py	Refactoring videos and archives UI paths for consistent scheme.	2026-03-20 15:38:32 -06:00
dev_build.sh	Postgres -> SQLite hard cutover: the database moves into the media directory.	2026-07-12 14:09:37 -06:00
find_and_convert_srt_to_vtt.py	Adding option to ignore errors in find_and_convert_srt_to_vtt.py.	2023-08-04 08:36:30 -06:00
find_and_rename_orphan_video_files.py	Bumping version for new feature.	2022-12-07 18:15:28 -07:00
find_corrupt_videos.py	Postgres -> SQLite hard cutover: the database moves into the media directory.	2026-07-12 14:09:37 -06:00
fix_media_permissions.sh	File permissions fix script checks for exfat and other file systems before trying to repair, displays a warning and gives advice on how to fix the issue.	2026-03-05 18:18:53 -07:00
generate_certificates.sh	Certificates: only include SANs permitted by the Root CA name constraints.	2026-07-05 12:38:08 -06:00
generate_subtitles.py	Creating script which finds all SRT files and converts them to VTT.	2023-08-03 22:36:11 -06:00
install_debian_12.sh	Caddy install: run gpg --dearmor with --batch --yes.	2026-07-05 13:03:11 -06:00
install_help_service.sh	Replacing Tag names with escaped tag names to avoid errors in Tags Directory.	2024-10-16 18:56:10 -06:00
install_protomaps.sh	Map search added to global search. Preview cards are displayed for all results in new Map tab.	2026-04-13 12:17:08 -06:00
install_raspberrypios.sh	Caddy install: run gpg --dearmor with --batch --yes.	2026-07-05 13:03:11 -06:00
renew_certificates.sh	Certificates: help.sh validates the CA and leaf certs; fix renew exec bit.	2026-07-09 16:00:43 -06:00
reset_api_db.sh	Postgres -> SQLite hard cutover: the database moves into the media directory.	2026-07-12 14:09:37 -06:00
reset_tags.sh	Postgres -> SQLite hard cutover: the database moves into the media directory.	2026-07-12 14:09:37 -06:00
reset_virtual_environments.sh	Clearing cached python files in repair.sh. Creating reset_virtual_environments.sh script which deletes the virtual environments and rebuilds them (requires internet)	2026-02-28 16:11:12 -07:00
singlefile_browser_wrapper.sh	Single file deno (#478)	2026-06-12 17:07:28 -06:00
singlefile_to_archive.py	A Channel can be tagged with a single Tag. The Channel can be moved into a Tag Directory according to the config.	2024-10-16 18:56:19 -06:00
start_kiwix_serve.sh	Replace nginx with Caddy for TLS termination and reverse proxying.	2026-03-07 18:48:44 -07:00
upgrade.sh	Postgres -> SQLite hard cutover: the database moves into the media directory.	2026-07-12 14:09:37 -06:00
upgrade_yt-dlp.sh	Creating script which updates yt-dlp in the wrolpi venv to the latest available.	2025-01-23 17:46:37 -07:00
wrolpi-usb.sh	Docs: recommend Raspberry Pi Imager instead of Etcher.	2026-07-03 18:58:54 -06:00