Commit graph

492 commits

Author SHA1 Message Date
Roland
5d50562768
Reworking Cards in the App so that they use the new FileGroup.files and .data. 2025-12-24 12:30:04 -07:00
Roland
298e852484 Creating FileGroup.directory, converting paths to relative to avoid updating all the paths on move. 2025-12-24 11:26:45 -07:00
Roland
4ba5226c68
Adding ext to archive file format to match video file format.
Some checks are pending
CodeQL / Analyze (push) Waiting to run
Controller Tests / controller-tests (push) Waiting to run
Jest Tests / jest-tests (push) Waiting to run
2025-12-23 19:11:07 -07:00
Roland
641fb368eb
Adding upload_year and upload_month to the video file format option. 2025-12-23 18:49:33 -07:00
Roland
80decbd560
Marking archives_downloader config as imported when it is imported. 2025-12-23 17:42:46 -07:00
Roland
1ebcae0965
Allowing user to configure collection download destination directories, as well as directories in the file structure. This will allow sorting archives by destination year, for example. 2025-12-23 16:46:15 -07:00
Roland
7183cf5e85
Automatically restarting kiwix container when new zim is downloaded using new Controller. 2025-12-19 17:55:27 -07:00
Roland
35853f2a59
Enhancing trace logging by switching to dev api service. 2025-12-19 17:55:06 -07:00
Roland
1ce8f499d8
Fixing archive bug where they did not download to the tagged domain's directory. 2025-12-18 17:39:33 -07:00
Roland
3e3694869b
Fixing bug where not all archives were modeled. 2025-12-18 17:19:57 -07:00
Roland
a8ff1a1c38
Updating archive downloader to use download.destination. 2025-12-17 16:56:58 -07:00
Roland
10d34d7390
Fixing download config import issue.
Some checks are pending
CodeQL / Analyze (push) Waiting to run
Controller Tests / controller-tests (push) Waiting to run
Jest Tests / jest-tests (push) Waiting to run
2025-12-16 19:59:28 -07:00
Roland
344fe9035f
Removing optional_session, passing session down from request middleware. Moving session param to the front of functions.
Some checks failed
CodeQL / Analyze (push) Has been cancelled
Jest Tests / jest-tests (push) Has been cancelled
2025-12-11 16:03:18 -07:00
Roland
1747442db3 Migrating move_channel functionality into move_collection so domain files are moved.
Some checks failed
CodeQL / Analyze (push) Has been cancelled
Jest Tests / jest-tests (push) Has been cancelled
2025-12-09 16:44:22 -07:00
Roland
c4267ec105
Batch processing in get_collections to speed up collection pages. 2025-12-07 17:42:04 -07:00
Roland
8a7f0737f0 Reformatting code. 2025-12-06 15:11:37 -07:00
Roland
5b29144d70 Testing that nearly-empty configs are ignored on import. Adding setting to disable automatic upgrade checking. 2025-12-06 15:11:37 -07:00
Roland
47044cdd1f Ensuring domain config saves when tagging/untagging a domain. 2025-12-06 15:11:37 -07:00
Roland
d7a02b5735 Speeding up channels config import. 2025-12-06 15:11:37 -07:00
Roland
79e0700609 Fixing local imports. 2025-12-06 15:11:37 -07:00
Roland
1d8738ace2 Running alembic check in cicd. 2025-12-06 15:11:37 -07:00
Roland
a1e0fb4e92 Creating a new Collection model for use in organizing FileGroups.
Replacing Channels and Domains with Collection.

Moving downloading relationships from Channel to Collection.

Created domains.yaml config to manage tagged domain collections.

Adding turn-key upgrade solution in the UI.
2025-12-06 15:11:37 -07:00
Roland
1ed0d63bac Creating Generate Screenshot button for Archives which are missing a screenshot. 2025-12-06 15:11:37 -07:00
Roland
41e1ed6be6
Using template0 when creating map db to avoid utf8 bug.
Some checks failed
CodeQL / Analyze (push) Has been cancelled
Fixed test_new_archive to handle platform-specific HTML formatting from BeautifulSoup.
Bumped version to 0.16.1-beta.
2025-11-24 07:50:50 -07:00
Roland
c635267eda
Fixing bug where Archive screenshots would not be tracked when a user uploads a screenshot.
Some checks failed
CodeQL / Analyze (push) Has been cancelled
2025-10-12 17:19:54 -06:00
Roland
2bca298ed3
Ignoring videos with no duration when filtering by min/max duration.
Some checks failed
CodeQL / Analyze (push) Has been cancelled
2025-09-14 09:23:21 -06:00
Roland
eb8124b391
Moving bestvideo/bestaudio to end of format selection so the preferred formats are downloaded first.
Some checks are pending
CodeQL / Analyze (push) Waiting to run
2025-09-13 17:56:20 -06:00
Roland
cd2fdce90a
Adding best matching video resolutions at the start of video download format lists. 2025-08-26 16:24:42 -06:00
Roland
8b4121fc2a
Loosening test requirements to avoid formatting difference between systems. 2025-08-22 11:03:10 -06:00
Roland
b14c153664
Setting default value for channel trigger columns. 2025-08-22 11:02:47 -06:00
Roland
25f9568154 Adding summary columns to Channel table. Adding triggers to keep columns updated. 2025-08-17 10:50:55 -06:00
Roland
338d961284 Adding file_group.effective_datetime to speed up video and archive browsing.
Some checks are pending
CodeQL / Analyze (push) Waiting to run
2025-08-16 11:38:22 -06:00
Roland
cff827383e
Marking download as complete when an archive is uploaded by singlefile browser extension. 2025-08-16 10:23:19 -06:00
Roland
76a454ea34
Linking to uploaded file on download after a user uploads a file with the same URL.
Some checks failed
CodeQL / Analyze (push) Has been cancelled
2025-08-11 16:54:10 -06:00
Roland
d7691fba71
Handling when Singlefile extension uploads may be not be the usual text/html.
Some checks failed
CodeQL / Analyze (push) Has been cancelled
2025-08-07 12:41:36 -06:00
Roland
76b9ead174
Handling rare error when parsing articles.
Some checks are pending
CodeQL / Analyze (push) Waiting to run
2025-08-06 15:01:40 -06:00
Roland
e8b8eb84a9
Logging queue size when converting singlefiles to archives. 2025-08-06 15:01:15 -06:00
Roland
57081e327e Converting singlefile_upload_switch_handler to use multiprocessing.Queue to enable uploading of multiple singlefile archives at once. 2025-08-06 14:05:21 -06:00
Roland
3725f0f39d Adding edit button so user can edit downloads, currently supports videos and archives. 2025-08-06 13:03:32 -06:00
Roland
2cca0dc778
Skipping archive test on circleci because it parses files differently.
Some checks failed
CodeQL / Analyze (push) Has been cancelled
2025-07-25 10:10:32 -06:00
Roland
f08790af05
Updating test_get_channel_videos_pagination to use channel_factory.
Some checks failed
CodeQL / Analyze (push) Has been cancelled
2025-07-20 16:40:24 -06:00
Roland
2dd182a10e
Adding vertical video formats to video downloader. 2025-07-20 16:17:43 -06:00
Roland
41c52b9c1e
Not using browser profile if it is disabled, even if always_user_browser_profile is enabled. This enables the user to selectively disable cookies. 2025-05-05 12:56:24 -06:00
Roland
deaeae9e9c
Adding more video formats to video resolutions. 2025-05-05 11:13:50 -06:00
Roland
00c86e1a1a
Searching wrolpi user's home directory for browser profiles. 2025-05-02 17:24:51 -06:00
Roland
3843279746
Fixing the rest of the tests for MacOS. 2025-04-14 22:23:37 -06:00
Roland
4900554a1d
Fixing some tests to work on MacOS for development. 2025-04-14 20:21:01 -06:00
Roland
12262b0802
Adding more video format versions now that more have been put out. 2025-03-28 10:27:22 -06:00
Roland
6a2969fa33
Removing unused code. 2025-03-28 10:26:38 -06:00
Roland
25cdbd7ba2
Updating map import times using 3.5GB pbf. 2025-03-25 15:52:43 -06:00