Roland
3906223844
Moving Channel attachment logic to recurring_download method because only recurring downloads can have Channels.
2024-10-16 18:56:13 -06:00
Roland
a98aebfdda
A video that is uploaded is attached to its Channel. Saving Channels config with both download url and frequency in case downloads config is corrupted.
2024-10-16 18:56:11 -06:00
Roland
0e99266379
A directory containing files that have been tagged is maintained automatically by WROLPi.
2024-10-16 18:56:05 -06:00
Roland
c839acb270
Converting Tag methods to use tag id or name.
2024-10-16 18:56:01 -06:00
Roland
2ad363281f
Delaying map startup because it prevents the API from starting.
2024-10-16 18:56:00 -06:00
Roland
af8bd7ba34
Cleaning up some extra data from video info json.
2024-10-16 18:55:59 -06:00
Roland
82af9a0d3c
Fixing bug where download.downloader would be replaced for all Channel Downloads.
2024-10-16 18:55:58 -06:00
Roland
7933d9625c
Downloads without a frequency cannot be a Channel Download.
2024-10-16 18:55:57 -06:00
Roland
53d2402d32
Only files that have been tagged will be returned when new 'Any' tag button is used to filter file search results.
2024-10-16 18:55:56 -06:00
Roland
f3439c2bd5
Adding feature so that tags can be applied when uploading files.
2024-10-16 18:55:55 -06:00
Roland
63738bd70f
Removing ChannelDownload in favor of Download.channel_id.
2024-10-16 18:55:54 -06:00
Roland
958dbb899d
Using uploader data as fallback for channel creation when downloading video.
2024-10-16 18:55:53 -06:00
Roland
cdc73d9d16
Trimming video file name to avoid error when file name is too long.
2024-10-16 18:55:52 -06:00
Roland
37ff1ab2cd
Changing title_match to title_include for clarity.
2024-10-16 18:55:51 -06:00
Roland
287beabb9c
Creating missing ChannelDownload when importing channels config.
2024-10-16 18:55:49 -06:00
Roland
50d95dad19
Channels now have Channel.channel_downloads. A Channel can have many Downloads.
2024-10-16 18:55:46 -06:00
Roland
638e92bd4e
Do not log entire file when singlefile creation fails.
2024-10-16 18:55:44 -06:00
Roland
a6647cc8f7
Adding FileGroup.censored when video can no longer be downloaded.
2024-10-16 18:55:43 -06:00
Roland
30a3ef1cac
Converting seconds_to_import to use param instead of global variable.
2024-06-17 14:49:20 -06:00
Roland
0fd545d2e8
Setting FileGroup.censored when refreshing channel files.
2024-06-17 14:48:41 -06:00
Roland
0bee458b79
Sorting keys when saving json file.
2024-06-13 14:08:07 -06:00
Roland
ae61977f0b
Reformatting.
2024-06-12 16:47:31 -06:00
Roland
67ebef4fef
Adding videos that can never be downloaded to skip list when download comments.
2024-06-12 16:39:23 -06:00
Roland
0fbbd36297
Creating perpetual funciton which checks if the internet is accessible. This is used to prevent downloads from starting when no internet exists.
2024-05-31 23:54:00 -06:00
Roland
2dae32fbcc
Moving singlefile checking to inside of do_singlefile function. Using User Agent when doing singlefile.
2024-05-28 19:18:51 -06:00
Roland
8a1b75855d
Testing search_channels_by_name.
2024-05-25 11:15:24 -06:00
Roland
bd8411bcd7
Updating test with Big Solidus.
2024-05-25 09:45:16 -06:00
Roland
d10a228692
Using stdout as error log when singlefile fails.
2024-05-25 09:40:29 -06:00
Roland
f9227f234c
Fixing logic error where multiprocessing dict was being ignored during initialization. Fixing test which expected the config to be a dict.
2024-05-19 15:46:43 -06:00
Roland
18373a466b
Preserving stdout to Download when singlefile fails.
2024-05-15 12:59:13 -06:00
Roland
9ee73af61d
Converting APIError to use SanicException as base.
2024-05-01 18:04:25 -06:00
Roland
58de8c7c5b
Upgrading Sanic and yt-dlp. Major changes occurred because Sanic changed how multiprocessing works.
...
Python 3.11 is now required, old versions were causing unpredictability in tests. (Sanic does not yet
support 3.12)
Sanic has been upgraded to 23.6.0, which is the latest version that avoids this bug:
https://github.com/sanic-org/sanic/issues/2921
New strategy for multiprocessing is to create all multiprocessing tools in one process, then fork
to other processes. The previous strategy was to declare multiprocessing tools at the top of every
file, or wherever they were needed at import/creation. Now all multiprocessing tools are attached to the
app.shared_ctx. This means `api_app` is imported in many, many places.
This forced a change in how the DownloadManager works. Previously, it would continually run
download workers which would pull downloads from a multiprocessing.Queue. Now, a single worker checks
for new downloads and sends a Sanic signal.
Flags have been reworked to use the `api_app`. I removed the `which` flag functionality because the
`which` are called at import and needed their own multiprocessing.Event.
2024-04-30 10:55:25 -06:00
Roland
2c127a03f5
Testing channel suggestions being ordered by video count.
2024-04-16 15:48:09 -06:00
Roland
7669cfe361
Ordering suggested channel names by video count.
2024-04-16 10:04:06 -06:00
Roland
ba2dd6dd11
Many fixes split out from the feature/unified-query branch. Installing diagnostic tools in the built images. Displaying video comment statistics. Echoing error when install.sh fails.
2024-04-14 13:13:30 -06:00
Roland
a665677ecc
Adding more lower-quality video formats to download when no other is available. Getting video ffprobe json when downloading.
2024-03-16 19:58:58 -06:00
Roland
947135985d
Reformatting code.
2024-03-12 17:20:51 -06:00
Roland
4b8b897eb3
Unifying YoutubeDL.
2024-03-12 16:52:26 -06:00
Roland
ce0ae66a9e
Storing video download_datetime.
2024-03-12 11:06:30 -06:00
Roland
2ec267a65b
Automatically backing up config files each day in config/backup directory.
2024-03-11 17:47:35 -06:00
Roland
a486a39b73
Channels config no longer supports favorites.
2024-03-10 16:44:08 -06:00
Roland
b05b2e7a6d
Allowing maintainer to change special directories.
2024-03-09 16:51:26 -07:00
Roland
00fe799b8f
User can select from/to years when searching files. Indexing doc and docx files.
2024-03-07 12:12:48 -07:00
Roland
758ff8e810
Creating background process that fetches comments for Videos that do not yet have comments.
...
Displaying star for Uploader's comments, heart for favorited comments.
Adding wrolpi help files desktop shortcut to rpi image.
Using zim file names as FileGroup.title.
Removing accidental output commit.
2024-03-01 17:15:56 -07:00
Roland
df849ffb42
Ordering video/archive results when no published_datetime exists. Adding Video.location property which returns the App location of the video.
2024-02-26 13:40:39 -07:00
Roland
b705e08e48
Handling if multiple videos exist at start of video download.
2024-02-22 13:12:26 -07:00
Roland
2aa30e1674
Getting video location to report errors when getting video metadata again.
2024-02-22 08:47:35 -07:00
Roland
0d6edc05d0
Duplicate videos are deleted when a video is downloaded.
2024-02-21 12:42:30 -07:00
Roland
08fa3af453
Moving video about pane to it's own segment to avoid tabs going out of mobile viewing area.
2024-02-20 15:13:18 -07:00
Roland
5629adc84c
Limiting normal video comment download limit.
2024-02-20 14:06:13 -07:00
