524 commits

Author	SHA1	Message	Date
Roland	d2d09da296	Video downloads are retried in an hour, if they are live.	2026-03-06 15:22:27 -07:00
Roland	0ffbc05e91	Unifying video download settings so that global/channel/rss/video ... download settings have inheritance. Allowing more granular control of potentially failed downloads.	2026-03-05 17:40:17 -07:00
Roland	9e52f658ea	Storing parent_download_url in a file group's json file after download has completed.	2026-03-03 15:54:22 -07:00
Roland	99eba4262c	Adding vertical download formats to video downloader.	2026-03-03 15:07:01 -07:00
Roland	71f20d8c59	Using shared context to sync cookies between processes.	2026-02-22 14:32:27 -07:00
Roland	0c059865e2	Updating download process to prevent rate limiting. ... * Added encrypted cookies feature for use with yt-dlp. Decrypted cookies never touch the disk. * Adding sleep between all downloads to prevent rapid requests. * Channels are fully refreshed before downloading. * Removing superseded video browser profile.	2026-02-21 14:08:00 -07:00
Roland	4537c63d89	Adding DEBUS to api systemd services.	2026-02-19 18:01:55 -07:00
Roland	929468821b	Using gnomekeyring for yt-dlp brave cookie parsing.	2026-02-19 17:44:57 -07:00
Roland	a49f67e117	Fetching video duration using api rather than using overpowered yt-dlp.	2026-02-19 16:49:38 -07:00
Roland	d8c51db5a3	Fetching video comments uses video downloader browser profile.	2026-02-19 16:25:35 -07:00
Roland	ae17152e79	Expanding video browser profile selection to match archive feature. Adding toggle to disable downloading missing video comments.	2026-02-19 16:15:18 -07:00
Roland	99a716aa13	Storing parent url for every child download, useful for knowing why WROLPi is downloading something. This is displayed on the Video and Archive download edit page. Updating Archive Download edit modal to use single url input.	2026-02-18 15:16:10 -07:00
Roland	71e3b307c3	Restarting wrolpi-kiwix when zim files are modeled.	2026-02-14 17:37:09 -07:00
Roland	3f5470d974	Channels are linked to downloads by directory or download source id when downloading, or when importing config.	2026-02-08 14:27:59 -07:00
Roland	a5dee64af2	Changing video view_count to bigint for popular videos.	2026-02-08 12:33:37 -07:00
Roland	387ef6dfe8	Saving video ffprobe json when video file is uploaded.	2026-02-08 12:29:25 -07:00
Roland	a6d6aaf9b4	Adding .ffprobe.json for video file groups to speed up re-indexing in the future; adding save_ffprobe_json to the WROLPiConfig to disable this feature.	2026-02-07 18:40:56 -07:00
Roland	fa5c116b62	Detecting collection directories using collection formatting rather than relying on parent directory of file groups, because those are now longer always in the collection directory.	2026-02-07 17:16:08 -07:00
Roland	8a4f9201f6	Using Channel name when reorganizing channel's files, fallback to info json uploader name (which may be outdated).	2026-02-05 11:48:25 -07:00
Roland	f5a48e3e7c	Falling back to video file name parser if we don't have enough info in the video's info json.	2026-02-05 08:52:29 -07:00
Roland	2c8f765f2b	Adding statistics page for Archives.	2026-02-02 15:15:28 -07:00
Roland	9005c0deff	Adding toggle to disable the tags directory feature.	2026-01-31 18:08:42 -07:00
Roland	74cb5171da	FileGroups in Collections can be reorganized in the Collection's directory. ... * Batch reorganization is supported for both Domain and Channel Collections. * Batch reorganization happens when any Collection does not match the respective file format. For example, a Channel Collection file format that does not match the `yt_dlp_options.file_name_format` will show `needs_reorganization`. * Individual Collections can always be reorganized. The reorganization is a little more aggressive. Useful for when some files may have been missed in the batch reorganization.	2026-01-31 18:08:41 -07:00
Roland	31af5120b8	Handling edge case when configs have absolute directories.	2026-01-23 15:29:20 -07:00
Roland	173284699d	FileWorker: Async queue-based file synchronization system ... Introduces FileWorker for background file operations with dual-queue architecture (public/private). Handles refresh, move, and rename tasks with progress tracking, job completion monitoring, and batch processing. Compares DB FileGroups to filesystem state using FileGroupDiff to detect new/modified/deleted files. Designed for memory efficiency on Raspberry Pi.	2026-01-23 15:29:15 -07:00
Roland	1d9b794fca	Converting JSON columns to JSONB for performance.	2026-01-06 06:23:32 -07:00
Roland	2a27d354a5	Creating AutoAwaitTestClient for tests which automatically runs background tasks and expires db objects.	2026-01-05 18:26:49 -07:00
Roland	3733eb4efd	Always refreshing channel in background task.	2025-12-26 13:43:51 -07:00
Roland	150ad6ee78	Deleting existing orphaned collections when no channel exists in the config.	2025-12-26 11:28:06 -07:00
Roland	b408d11ea1	Deleting orphaned collections when no channel is in the channels config.	2025-12-26 10:00:32 -07:00
Roland	2b0b161dad	Changing archive special directory default to include domain tag.	2025-12-25 15:42:35 -07:00
Roland	166d6a47c3	Removing PYTEST from channel move to avoid missing session.	2025-12-24 17:42:17 -07:00
Roland	5d50562768	Reworking Cards in the App so that they use the new FileGroup.files and .data.	2025-12-24 12:30:04 -07:00
Roland	298e852484	Creating FileGroup.directory, converting paths to relative to avoid updating all the paths on move.	2025-12-24 11:26:45 -07:00
Roland	4ba5226c68	Adding ext to archive file format to match video file format.	2025-12-23 19:11:07 -07:00
Roland	641fb368eb	Adding upload_year and upload_month to the video file format option.	2025-12-23 18:49:33 -07:00
Roland	80decbd560	Marking archives_downloader config as imported when it is imported.	2025-12-23 17:42:46 -07:00
Roland	1ebcae0965	Allowing user to configure collection download destination directories, as well as directories in the file structure. This will allow sorting archives by destination year, for example.	2025-12-23 16:46:15 -07:00
Roland	7183cf5e85	Automatically restarting kiwix container when new zim is downloaded using new Controller.	2025-12-19 17:55:27 -07:00
Roland	35853f2a59	Enhancing trace logging by switching to dev api service.	2025-12-19 17:55:06 -07:00
Roland	1ce8f499d8	Fixing archive bug where they did not download to the tagged domain's directory.	2025-12-18 17:39:33 -07:00
Roland	3e3694869b	Fixing bug where not all archives were modeled.	2025-12-18 17:19:57 -07:00
Roland	a8ff1a1c38	Updating archive downloader to use download.destination.	2025-12-17 16:56:58 -07:00
Roland	10d34d7390	Fixing download config import issue.	2025-12-16 19:59:28 -07:00
Roland	344fe9035f	Removing optional_session, passing session down from request middleware. Moving session param to the front of functions.	2025-12-11 16:03:18 -07:00
Roland	1747442db3	Migrating move_channel functionality into move_collection so domain files are moved.	2025-12-09 16:44:22 -07:00
Roland	c4267ec105	Batch processing in get_collections to speed up collection pages.	2025-12-07 17:42:04 -07:00
Roland	8a7f0737f0	Reformatting code.	2025-12-06 15:11:37 -07:00
Roland	5b29144d70	Testing that nearly-empty configs are ignored on import. Adding setting to disable automatic upgrade checking.	2025-12-06 15:11:37 -07:00
Roland	47044cdd1f	Ensuring domain config saves when tagging/untagging a domain.	2025-12-06 15:11:37 -07:00