Commit graph

1237 commits

Author SHA1 Message Date
Roland
3ff4f2eee4
Testing log level can change. 2024-05-18 19:36:18 -06:00
Roland
71cf292728
Creating cache directory in API Docker container for yt-dlp. 2024-05-18 19:13:41 -06:00
Roland
57ae4c1a23
Changing log level for all handlers when global level changes. 2024-05-18 18:48:15 -06:00
Roland
213c4c0746
Showing top 80% of Channels. 2024-05-18 18:36:20 -06:00
Roland
c3ca65b7c6
Making WROLPi name stand out in Nav bar. 2024-05-18 17:51:06 -06:00
Roland
f00cd30b77
Using more processes on-the-metal. 2024-05-18 17:50:31 -06:00
Roland
a06419d9ac
Handling listing files when we do not have read permissions. 2024-05-18 17:50:08 -06:00
Roland
b574867a08
Echoing that build is successful. 2024-05-15 12:59:24 -06:00
Roland
18373a466b
Preserving stdout to Download when singlefile fails. 2024-05-15 12:59:13 -06:00
Roland
95ecfcac04
Fixing tests that rely on empty ignored directories. 2024-05-14 20:56:04 -06:00
Roland
ad8433f9f4
Bumping WROLPi Help version. 2024-05-14 20:34:22 -06:00
Roland
7298025774
Showing Getters when refresh is complete. 2024-05-14 20:30:29 -06:00
Roland
86355b664d
Using older version of single-file-cli to avoid error. 2024-05-14 20:29:57 -06:00
Roland
7cdf5f3323
get config file after initializing multiprocessing. 2024-05-14 20:29:19 -06:00
Roland
18a652e933
Increasing frequency that downloads are started. 2024-05-14 20:28:12 -06:00
Roland
68d778d9b8
Stripping trailing / from directory when un-ignoring. 2024-05-08 20:33:57 -06:00
Roland
8a995a90e3
Using single multiprocessing.Manager. 2024-05-08 20:33:43 -06:00
Roland
517cabf105
Bumping wrolpi-help version. 2024-05-08 20:08:32 -06:00
Roland
0050e223cc
Adding config directory to default ignore list. 2024-05-08 20:07:51 -06:00
Roland
265c08f25c
Testing that react app can be built and started. 2024-05-08 19:16:55 -06:00
Roland
3a1e0282c4
Bumping react-stl-viewer version. 2024-05-08 18:37:46 -06:00
dependabot[bot]
e8ac6ba76a
Bump ejs from 3.1.8 to 3.1.10 in /app
Bumps [ejs](https://github.com/mde/ejs) from 3.1.8 to 3.1.10.
- [Release notes](https://github.com/mde/ejs/releases)
- [Commits](https://github.com/mde/ejs/compare/v3.1.8...v3.1.10)

---
updated-dependencies:
- dependency-name: ejs
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-05-08 18:23:01 -06:00
Roland
ee99803586
Testing node 22. 2024-05-08 18:18:52 -06:00
Roland
a527b0091d
Changing default log level back to INFO. 2024-05-08 18:05:09 -06:00
Roland
fd619853b6
Videos/Archives search input is clearable. 2024-05-08 17:44:44 -06:00
Roland
cd00df5c13
Converting flags to a dict. Using test_async_client wherever tests required it. 2024-05-08 17:31:15 -06:00
Roland
63381c1d77
Created download retry button. 2024-05-08 17:05:12 -06:00
Roland
bd16ad1e0c
Using truthy_arg for DOCKERIZED and CIRCLECI vars. 2024-05-07 10:55:05 -06:00
Roland
d50534b0b7
Storing junit test results file. 2024-05-07 10:50:06 -06:00
Roland
8ad653fc40
Testing that api can start. 2024-05-07 10:39:00 -06:00
Roland
a65fa1c6fb
Removing start_initialize_flags because flags are initted in perpetual_check_db_is_up_worker. Logging when flags are initialized. 2024-05-07 09:42:50 -06:00
Roland
d0c9bec7f4
Modifying singlefile_to_archive to accept file list in stdin. 2024-05-07 09:41:48 -06:00
Roland
994486b52f
Replacing | in filenames with -. 2024-05-07 09:41:27 -06:00
Roland
f0e4302de8
Restoring main.py as method to start WROLPi API because it is required to upgrade docker database. 2024-05-02 10:56:43 -06:00
Roland
2924867f55
Bumping single-file-cli version for all systems. 2024-05-02 09:09:21 -06:00
Roland
ff20ffc5aa
Removing noisy downloader debugging log. 2024-05-01 19:49:31 -06:00
Roland
c9db5f5483
Matching sanic-ext, sanic-testing to sanic version. 2024-05-01 19:49:20 -06:00
Roland
93e6188be4
aiohttp updated response.status. I created a test which tests aiottp convenience functions. 2024-05-01 19:35:35 -06:00
Roland
023dfc68e0
Verifying that root_api is imported before starting WROLPi API. 2024-05-01 18:59:25 -06:00
Roland
41f3969330
Modifying launch of API to use 'sanic' executable. This was done because startup is much faster. 2024-05-01 18:42:52 -06:00
Roland
9ee73af61d
Converting APIError to use SanicException as base. 2024-05-01 18:04:25 -06:00
Roland
58de8c7c5b
Upgrading Sanic and yt-dlp. Major changes occurred because Sanic changed how multiprocessing works.
Python 3.11 is now required, old versions were causing unpredictability in tests.  (Sanic does not yet
support 3.12)

Sanic has been upgraded to 23.6.0, which is the latest version that avoids this bug:
 https://github.com/sanic-org/sanic/issues/2921

New strategy for multiprocessing is to create all multiprocessing tools in one process, then fork
to other processes.  The previous strategy was to declare multiprocessing tools at the top of every
file, or wherever they were needed at import/creation.  Now all multiprocessing tools are attached to the
app.shared_ctx.  This means `api_app` is imported in many, many places.

This forced a change in how the DownloadManager works.  Previously, it would continually run
download workers which would pull downloads from a multiprocessing.Queue.  Now, a single worker checks
for new downloads and sends a Sanic signal.

Flags have been reworked to use the `api_app`.  I removed the `which` flag functionality because the
`which` are called at import and needed their own multiprocessing.Event.
2024-04-30 10:55:25 -06:00
Roland
2c127a03f5
Testing channel suggestions being ordered by video count. 2024-04-16 15:48:09 -06:00
Roland
4564a99771
Bumping video comment fetch count to 80. 2024-04-16 10:36:32 -06:00
Roland
62c4afce0b
Modifying height of iframes for Map/Zim viewers to show full page of iframe. 2024-04-16 10:34:05 -06:00
Roland
ed1ed94beb
Replacing download count span with semanticui Label. 2024-04-16 10:14:47 -06:00
Roland
a5fb634766
Only searching suggestions when searchStr has a value. 2024-04-16 10:10:16 -06:00
Roland
7669cfe361
Ordering suggested channel names by video count. 2024-04-16 10:04:06 -06:00
Roland
969a065a6c
Splitting FileGroups from search suggestions to speed up channel/domain response time. 2024-04-16 09:46:47 -06:00
Roland
65f94b4807
Reformatting app files. 2024-04-14 14:05:22 -06:00