503 commits

Author	SHA1	Message	Date
Roland	9005c0deff	Adding toggle to disable the tags directory feature.	2026-01-31 18:08:42 -07:00
Roland	74cb5171da	FileGroups in Collections can be reorganized in the Collection's directory. ... * Batch reorganization is supported for both Domain and Channel Collections. * Batch reorganization happens when any Collection does not match the respective file format. For example, a Channel Collection file format that does not match the `yt_dlp_options.file_name_format` will show `needs_reorganization`. * Individual Collections can always be reorganized. The reorganization is a little more aggressive. Useful for when some files may have been missed in the batch reorganization.	2026-01-31 18:08:41 -07:00
Roland	31af5120b8	Handling edge case when configs have absolute directories.	2026-01-23 15:29:20 -07:00
Roland	173284699d	FileWorker: Async queue-based file synchronization system ... Introduces FileWorker for background file operations with dual-queue architecture (public/private). Handles refresh, move, and rename tasks with progress tracking, job completion monitoring, and batch processing. Compares DB FileGroups to filesystem state using FileGroupDiff to detect new/modified/deleted files. Designed for memory efficiency on Raspberry Pi.	2026-01-23 15:29:15 -07:00
Roland	1d9b794fca	Converting JSON columns to JSONB for performance.	2026-01-06 06:23:32 -07:00
Roland	2a27d354a5	Creating AutoAwaitTestClient for tests which automatically runs background tasks and expires db objects.	2026-01-05 18:26:49 -07:00
Roland	3733eb4efd	Always refreshing channel in background task.	2025-12-26 13:43:51 -07:00
Roland	150ad6ee78	Deleting existing orphaned collections when no channel exists in the config.	2025-12-26 11:28:06 -07:00
Roland	b408d11ea1	Deleting orphaned collections when no channel is in the channels config.	2025-12-26 10:00:32 -07:00
Roland	2b0b161dad	Changing archive special directory default to include domain tag.	2025-12-25 15:42:35 -07:00
Roland	166d6a47c3	Removing PYTEST from channel move to avoid missing session.	2025-12-24 17:42:17 -07:00
Roland	5d50562768	Reworking Cards in the App so that they use the new FileGroup.files and .data.	2025-12-24 12:30:04 -07:00
Roland	298e852484	Creating FileGroup.directory, converting paths to relative to avoid updating all the paths on move.	2025-12-24 11:26:45 -07:00
Roland	4ba5226c68	Adding ext to archive file format to match video file format.	2025-12-23 19:11:07 -07:00
Roland	641fb368eb	Adding upload_year and upload_month to the video file format option.	2025-12-23 18:49:33 -07:00
Roland	80decbd560	Marking archives_downloader config as imported when it is imported.	2025-12-23 17:42:46 -07:00
Roland	1ebcae0965	Allowing user to configure collection download destination directories, as well as directories in the file structure. This will allow sorting archives by destination year, for example.	2025-12-23 16:46:15 -07:00
Roland	7183cf5e85	Automatically restarting kiwix container when new zim is downloaded using new Controller.	2025-12-19 17:55:27 -07:00
Roland	35853f2a59	Enhancing trace logging by switching to dev api service.	2025-12-19 17:55:06 -07:00
Roland	1ce8f499d8	Fixing archive bug where they did not download to the tagged domain's directory.	2025-12-18 17:39:33 -07:00
Roland	3e3694869b	Fixing bug where not all archives were modeled.	2025-12-18 17:19:57 -07:00
Roland	a8ff1a1c38	Updating archive downloader to use download.destination.	2025-12-17 16:56:58 -07:00
Roland	10d34d7390	Fixing download config import issue.	2025-12-16 19:59:28 -07:00
Roland	344fe9035f	Removing optional_session, passing session down from request middleware. Moving session param to the front of functions.	2025-12-11 16:03:18 -07:00
Roland	1747442db3	Migrating move_channel functionality into move_collection so domain files are moved.	2025-12-09 16:44:22 -07:00
Roland	c4267ec105	Batch processing in get_collections to speed up collection pages.	2025-12-07 17:42:04 -07:00
Roland	8a7f0737f0	Reformatting code.	2025-12-06 15:11:37 -07:00
Roland	5b29144d70	Testing that nearly-empty configs are ignored on import. Adding setting to disable automatic upgrade checking.	2025-12-06 15:11:37 -07:00
Roland	47044cdd1f	Ensuring domain config saves when tagging/untagging a domain.	2025-12-06 15:11:37 -07:00
Roland	d7a02b5735	Speeding up channels config import.	2025-12-06 15:11:37 -07:00
Roland	79e0700609	Fixing local imports.	2025-12-06 15:11:37 -07:00
Roland	1d8738ace2	Running alembic check in cicd.	2025-12-06 15:11:37 -07:00
Roland	a1e0fb4e92	Creating a new Collection model for use in organizing FileGroups. ... Replacing Channels and Domains with Collection. Moving downloading relationships from Channel to Collection. Created domains.yaml config to manage tagged domain collections. Adding turn-key upgrade solution in the UI.	2025-12-06 15:11:37 -07:00
Roland	1ed0d63bac	Creating Generate Screenshot button for Archives which are missing a screenshot.	2025-12-06 15:11:37 -07:00
Roland	41e1ed6be6	Using template0 when creating map db to avoid utf8 bug. ... Fixed test_new_archive to handle platform-specific HTML formatting from BeautifulSoup. Bumped version to 0.16.1-beta.	2025-11-24 07:50:50 -07:00
Roland	c635267eda	Fixing bug where Archive screenshots would not be tracked when a user uploads a screenshot.	2025-10-12 17:19:54 -06:00
Roland	2bca298ed3	Ignoring videos with no duration when filtering by min/max duration.	2025-09-14 09:23:21 -06:00
Roland	eb8124b391	Moving bestvideo/bestaudio to end of format selection so the preferred formats are downloaded first.	2025-09-13 17:56:20 -06:00
Roland	cd2fdce90a	Adding best matching video resolutions at the start of video download format lists.	2025-08-26 16:24:42 -06:00
Roland	8b4121fc2a	Loosening test requirements to avoid formatting difference between systems.	2025-08-22 11:03:10 -06:00
Roland	b14c153664	Setting default value for channel trigger columns.	2025-08-22 11:02:47 -06:00
Roland	25f9568154	Adding summary columns to Channel table. Adding triggers to keep columns updated.	2025-08-17 10:50:55 -06:00
Roland	338d961284	Adding file_group.effective_datetime to speed up video and archive browsing.	2025-08-16 11:38:22 -06:00
Roland	cff827383e	Marking download as complete when an archive is uploaded by singlefile browser extension.	2025-08-16 10:23:19 -06:00
Roland	76a454ea34	Linking to uploaded file on download after a user uploads a file with the same URL.	2025-08-11 16:54:10 -06:00
Roland	d7691fba71	Handling when Singlefile extension uploads may be not be the usual text/html.	2025-08-07 12:41:36 -06:00
Roland	76b9ead174	Handling rare error when parsing articles.	2025-08-06 15:01:40 -06:00
Roland	e8b8eb84a9	Logging queue size when converting singlefiles to archives.	2025-08-06 15:01:15 -06:00
Roland	57081e327e	Converting singlefile_upload_switch_handler to use multiprocessing.Queue to enable uploading of multiple singlefile archives at once.	2025-08-06 14:05:21 -06:00
Roland	3725f0f39d	Adding edit button so user can edit downloads, currently supports videos and archives.	2025-08-06 13:03:32 -06:00