Roland
9468448a54
Modifying Video/Channel/RSS Downloaders so that they can download videos, but audio only. These audio files are grouped under their channel directories.
2026-04-14 15:33:01 -06:00
Roland
755b133fa4
Fixing bug where configs could be overwritten with empty configs on first refresh. Fixing bug where configs were displayed as JSON in admin settings.
2026-03-22 12:56:37 -06:00
Roland
da6e62ee45
Backup configs can be restored in the UI. User can choose between Merge or Overwrite, the UI displays a comparison. Configs are compared when user opens the restore modal, configs which won't cause changes are marked.
2026-03-10 20:30:46 -06:00
Roland
0ffbc05e91
Unifying video download settings so that global/channel/rss/video
...
download settings have inheritance. Allowing more granular control of
potentially failed downloads.
2026-03-05 17:40:17 -07:00
Roland
0c059865e2
Updating download process to prevent rate limiting.
...
* Added encrypted cookies feature for use with yt-dlp. Decrypted cookies never touch the disk.
* Adding sleep between all downloads to prevent rapid requests.
* Channels are fully refreshed before downloading.
* Removing superseded video browser profile.
2026-02-21 14:08:00 -07:00
Roland
929468821b
Using gnomekeyring for yt-dlp brave cookie parsing.
2026-02-19 17:44:57 -07:00
Roland
a49f67e117
Fetching video duration using api rather than using overpowered yt-dlp.
2026-02-19 16:49:38 -07:00
Roland
d8c51db5a3
Fetching video comments uses video downloader browser profile.
2026-02-19 16:25:35 -07:00
Roland
ae17152e79
Expanding video browser profile selection to match archive feature. Adding toggle to disable downloading missing video comments.
2026-02-19 16:15:18 -07:00
Roland
3f5470d974
Channels are linked to downloads by directory or download source id when downloading, or when importing config.
2026-02-08 14:27:59 -07:00
Roland
387ef6dfe8
Saving video ffprobe json when video file is uploaded.
2026-02-08 12:29:25 -07:00
Roland
8a4f9201f6
Using Channel name when reorganizing channel's files, fallback to info json uploader name (which may be outdated).
CodeQL / Analyze (push) Has been cancelled
Controller Tests / controller-tests (push) Has been cancelled
Jest Tests / jest-tests (push) Has been cancelled
2026-02-05 11:48:25 -07:00
Roland
f5a48e3e7c
Falling back to video file name parser if we don't have enough info in the video's info json.
2026-02-05 08:52:29 -07:00
Roland
74cb5171da
FileGroups in Collections can be reorganized in the Collection's directory.
...
* Batch reorganization is supported for both Domain and Channel Collections.
* Batch reorganization happens when any Collection does not match the respective file format. For example, a Channel Collection file format that does not match the `yt_dlp_options.file_name_format` will show `needs_reorganization`.
* Individual Collections can always be reorganized. The reorganization is a little more aggressive. Useful for when some files may have been missed in the batch reorganization.
2026-01-31 18:08:41 -07:00
Roland
150ad6ee78
Deleting existing orphaned collections when no channel exists in the config.
2025-12-26 11:28:06 -07:00
Roland
b408d11ea1
Deleting orphaned collections when no channel is in the channels config.
2025-12-26 10:00:32 -07:00
Roland
298e852484
Creating FileGroup.directory, converting paths to relative to avoid updating all the paths on move.
2025-12-24 11:26:45 -07:00
Roland
1ebcae0965
Allowing user to configure collection download destination directories, as well as directories in the file structure. This will allow sorting archives by destination year, for example.
2025-12-23 16:46:15 -07:00
Roland
344fe9035f
Removing optional_session, passing session down from request middleware. Moving session param to the front of functions.
CodeQL / Analyze (push) Has been cancelled
Jest Tests / jest-tests (push) Has been cancelled
2025-12-11 16:03:18 -07:00
Roland
5b29144d70
Testing that nearly-empty configs are ignored on import. Adding setting to disable automatic upgrade checking.
2025-12-06 15:11:37 -07:00
Roland
d7a02b5735
Speeding up channels config import.
2025-12-06 15:11:37 -07:00
Roland
a1e0fb4e92
Creating a new Collection model for use in organizing FileGroups.
...
Replacing Channels and Domains with Collection.
Moving downloading relationships from Channel to Collection.
Created domains.yaml config to manage tagged domain collections.
Adding turn-key upgrade solution in the UI.
2025-12-06 15:11:37 -07:00
Roland
00c86e1a1a
Searching wrolpi user's home directory for browser profiles.
2025-05-02 17:24:51 -06:00
Roland
581d5eaf6e
Adding toggle to Channel page to stop downloading comments for certain channels.
2025-03-01 18:23:29 -07:00
Roland
15f6e7ed5c
Handling new issue with youtube caption file names. Adding QR Code calculator.
2025-02-07 11:44:17 -07:00
Roland
08a67eaf74
Fixing starting downloads on startup.
2024-12-26 14:45:10 -07:00
Roland
bf29bdcff7
Displaying error when video file name format is invalid.
2024-11-29 17:01:16 -07:00
Roland
b7d163e7ff
Config files are initialized on startup, if they are missing.
2024-11-28 18:13:43 -07:00
Roland
5621d47309
Video downloads have many more options. Downloads are migrated.
...
Storing video settings in session storage to help user start downloads consistently.
Applying channel tag name to new channels when download videos or channels.
Initializing map tiles when importing and resetting map.
2024-11-28 09:48:57 -07:00
Roland
04d92dca09
Not deleting video poster when converting to jpg.
2024-10-16 18:57:22 -06:00
Roland
584fdadcb7
Getting file name from yt-dlp error when video file name is too long, trimming that long file name.
2024-10-16 18:56:56 -06:00
Roland
acf3dee179
Configs are displayed in new ConfigsPage under Admin.
...
- Configs can be imported and saved.
- Configs are validated before imported.
- API will refuse to save a config if it was not imported successfully.
2024-10-16 18:56:45 -06:00
Roland
d34301a085
Configs are imported manually in main. Configs now have dump/save/import methods. Configs will refuse to save if they have not been imported.
2024-10-16 18:56:44 -06:00
Roland
d3e5b56520
Bumping python requirements versions.
2024-10-16 18:56:41 -06:00
Roland
d54735c4bb
Configs can be saved in background using switches.
2024-10-16 18:56:38 -06:00
Roland
87930e5281
Logging when channel import is complete.
2024-10-16 18:56:36 -06:00
Roland
317f3f3dfb
Top processes are displayed on Status page. Nice of renderd is lowered to avoid clobbering system at startup.
2024-10-16 18:56:27 -06:00
Roland
0f232fd533
Moving FileGroups instead of refreshing files after they have been moved.
2024-10-16 18:56:25 -06:00
Roland
45167e4f32
A Channel can be tagged with a single Tag. The Channel can be moved into a Tag Directory according to the config.
2024-10-16 18:56:19 -06:00
Roland
2ad363281f
Delaying map startup because it prevents the API from starting.
2024-10-16 18:56:00 -06:00
Roland
7933d9625c
Downloads without a frequency cannot be a Channel Download.
2024-10-16 18:55:57 -06:00
Roland
f3439c2bd5
Adding feature so that tags can be applied when uploading files.
2024-10-16 18:55:55 -06:00
Roland
63738bd70f
Removing ChannelDownload in favor of Download.channel_id.
2024-10-16 18:55:54 -06:00
Roland
958dbb899d
Using uploader data as fallback for channel creation when downloading video.
2024-10-16 18:55:53 -06:00
Roland
cdc73d9d16
Trimming video file name to avoid error when file name is too long.
2024-10-16 18:55:52 -06:00
Roland
287beabb9c
Creating missing ChannelDownload when importing channels config.
2024-10-16 18:55:49 -06:00
Roland
50d95dad19
Channels now have Channel.channel_downloads. A Channel can have many Downloads.
2024-10-16 18:55:46 -06:00
Roland
58de8c7c5b
Upgrading Sanic and yt-dlp. Major changes occurred because Sanic changed how multiprocessing works.
...
Python 3.11 is now required, old versions were causing unpredictability in tests. (Sanic does not yet
support 3.12)
Sanic has been upgraded to 23.6.0, which is the latest version that avoids this bug:
https://github.com/sanic-org/sanic/issues/2921
New strategy for multiprocessing is to create all multiprocessing tools in one process, then fork
to other processes. The previous strategy was to declare multiprocessing tools at the top of every
file, or wherever they were needed at import/creation. Now all multiprocessing tools are attached to the
app.shared_ctx. This means `api_app` is imported in many, many places.
This forced a change in how the DownloadManager works. Previously, it would continually run
download workers which would pull downloads from a multiprocessing.Queue. Now, a single worker checks
for new downloads and sends a Sanic signal.
Flags have been reworked to use the `api_app`. I removed the `which` flag functionality because the
`which` are called at import and needed their own multiprocessing.Event.
2024-04-30 10:55:25 -06:00
Roland
ba2dd6dd11
Many fixes split out from the feature/unified-query branch. Installing diagnostic tools in the built images. Displaying video comment statistics. Echoing error when install.sh fails.
2024-04-14 13:13:30 -06:00
Roland
4b8b897eb3
Unifying YoutubeDL.
2024-03-12 16:52:26 -06:00