Commit graph

1225 commits

Author SHA1 Message Date
Roland
86355b664d
Using older version of single-file-cli to avoid error. 2024-05-14 20:29:57 -06:00
Roland
7cdf5f3323
get config file after initializing multiprocessing. 2024-05-14 20:29:19 -06:00
Roland
18a652e933
Increasing frequency that downloads are started. 2024-05-14 20:28:12 -06:00
Roland
68d778d9b8
Stripping trailing / from directory when un-ignoring. 2024-05-08 20:33:57 -06:00
Roland
8a995a90e3
Using single multiprocessing.Manager. 2024-05-08 20:33:43 -06:00
Roland
517cabf105
Bumping wrolpi-help version. 2024-05-08 20:08:32 -06:00
Roland
0050e223cc
Adding config directory to default ignore list. 2024-05-08 20:07:51 -06:00
Roland
265c08f25c
Testing that react app can be built and started. 2024-05-08 19:16:55 -06:00
Roland
3a1e0282c4
Bumping react-stl-viewer version. 2024-05-08 18:37:46 -06:00
dependabot[bot]
e8ac6ba76a
Bump ejs from 3.1.8 to 3.1.10 in /app
Bumps [ejs](https://github.com/mde/ejs) from 3.1.8 to 3.1.10.
- [Release notes](https://github.com/mde/ejs/releases)
- [Commits](https://github.com/mde/ejs/compare/v3.1.8...v3.1.10)

---
updated-dependencies:
- dependency-name: ejs
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-05-08 18:23:01 -06:00
Roland
ee99803586
Testing node 22. 2024-05-08 18:18:52 -06:00
Roland
a527b0091d
Changing default log level back to INFO. 2024-05-08 18:05:09 -06:00
Roland
fd619853b6
Videos/Archives search input is clearable. 2024-05-08 17:44:44 -06:00
Roland
cd00df5c13
Converting flags to a dict. Using test_async_client wherever tests required it. 2024-05-08 17:31:15 -06:00
Roland
63381c1d77
Created download retry button. 2024-05-08 17:05:12 -06:00
Roland
bd16ad1e0c
Using truthy_arg for DOCKERIZED and CIRCLECI vars. 2024-05-07 10:55:05 -06:00
Roland
d50534b0b7
Storing junit test results file. 2024-05-07 10:50:06 -06:00
Roland
8ad653fc40
Testing that api can start. 2024-05-07 10:39:00 -06:00
Roland
a65fa1c6fb
Removing start_initialize_flags because flags are initted in perpetual_check_db_is_up_worker. Logging when flags are initialized. 2024-05-07 09:42:50 -06:00
Roland
d0c9bec7f4
Modifying singlefile_to_archive to accept file list in stdin. 2024-05-07 09:41:48 -06:00
Roland
994486b52f
Replacing | in filenames with -. 2024-05-07 09:41:27 -06:00
Roland
f0e4302de8
Restoring main.py as method to start WROLPi API because it is required to upgrade docker database. 2024-05-02 10:56:43 -06:00
Roland
2924867f55
Bumping single-file-cli version for all systems. 2024-05-02 09:09:21 -06:00
Roland
ff20ffc5aa
Removing noisy downloader debugging log. 2024-05-01 19:49:31 -06:00
Roland
c9db5f5483
Matching sanic-ext, sanic-testing to sanic version. 2024-05-01 19:49:20 -06:00
Roland
93e6188be4
aiohttp updated response.status. I created a test which tests aiottp convenience functions. 2024-05-01 19:35:35 -06:00
Roland
023dfc68e0
Verifying that root_api is imported before starting WROLPi API. 2024-05-01 18:59:25 -06:00
Roland
41f3969330
Modifying launch of API to use 'sanic' executable. This was done because startup is much faster. 2024-05-01 18:42:52 -06:00
Roland
9ee73af61d
Converting APIError to use SanicException as base. 2024-05-01 18:04:25 -06:00
Roland
58de8c7c5b
Upgrading Sanic and yt-dlp. Major changes occurred because Sanic changed how multiprocessing works.
Python 3.11 is now required, old versions were causing unpredictability in tests.  (Sanic does not yet
support 3.12)

Sanic has been upgraded to 23.6.0, which is the latest version that avoids this bug:
 https://github.com/sanic-org/sanic/issues/2921

New strategy for multiprocessing is to create all multiprocessing tools in one process, then fork
to other processes.  The previous strategy was to declare multiprocessing tools at the top of every
file, or wherever they were needed at import/creation.  Now all multiprocessing tools are attached to the
app.shared_ctx.  This means `api_app` is imported in many, many places.

This forced a change in how the DownloadManager works.  Previously, it would continually run
download workers which would pull downloads from a multiprocessing.Queue.  Now, a single worker checks
for new downloads and sends a Sanic signal.

Flags have been reworked to use the `api_app`.  I removed the `which` flag functionality because the
`which` are called at import and needed their own multiprocessing.Event.
2024-04-30 10:55:25 -06:00
Roland
2c127a03f5
Testing channel suggestions being ordered by video count. 2024-04-16 15:48:09 -06:00
Roland
4564a99771
Bumping video comment fetch count to 80. 2024-04-16 10:36:32 -06:00
Roland
62c4afce0b
Modifying height of iframes for Map/Zim viewers to show full page of iframe. 2024-04-16 10:34:05 -06:00
Roland
ed1ed94beb
Replacing download count span with semanticui Label. 2024-04-16 10:14:47 -06:00
Roland
a5fb634766
Only searching suggestions when searchStr has a value. 2024-04-16 10:10:16 -06:00
Roland
7669cfe361
Ordering suggested channel names by video count. 2024-04-16 10:04:06 -06:00
Roland
969a065a6c
Splitting FileGroups from search suggestions to speed up channel/domain response time. 2024-04-16 09:46:47 -06:00
Roland
65f94b4807
Reformatting app files. 2024-04-14 14:05:22 -06:00
Roland
5be4726493
Displaying error when re-download of Archive request fails. 2024-04-14 14:02:02 -06:00
Roland
1795fae1b0
Merging useSearchMonths and useSearchDateRange into useSearchDate to avoid setting query twice when closing DateSelectorModal. 2024-04-14 14:01:07 -06:00
Roland
278606f031
Moving Videos Comments Statistics to their own segment. 2024-04-14 13:15:00 -06:00
Roland
ba2dd6dd11
Many fixes split out from the feature/unified-query branch. Installing diagnostic tools in the built images. Displaying video comment statistics. Echoing error when install.sh fails. 2024-04-14 13:13:30 -06:00
dependabot[bot]
78806b6060 Bump express from 4.18.2 to 4.19.2 in /app
Bumps [express](https://github.com/expressjs/express) from 4.18.2 to 4.19.2.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.18.2...4.19.2)

---
updated-dependencies:
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-04-14 13:07:08 -06:00
dependabot[bot]
56601b9c89 Bump pillow from 10.2.0 to 10.3.0
Bumps [pillow](https://github.com/python-pillow/Pillow) from 10.2.0 to 10.3.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/10.2.0...10.3.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-04-14 13:06:59 -06:00
dependabot[bot]
1d4e0117e6 Bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /app
Bumps [webpack-dev-middleware](https://github.com/webpack/webpack-dev-middleware) from 5.3.3 to 5.3.4.
- [Release notes](https://github.com/webpack/webpack-dev-middleware/releases)
- [Changelog](https://github.com/webpack/webpack-dev-middleware/blob/v5.3.4/CHANGELOG.md)
- [Commits](https://github.com/webpack/webpack-dev-middleware/compare/v5.3.3...v5.3.4)

---
updated-dependencies:
- dependency-name: webpack-dev-middleware
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-04-14 13:06:47 -06:00
dependabot[bot]
0fb515287b Bump follow-redirects from 1.15.4 to 1.15.6 in /app
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.15.4 to 1.15.6.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.15.4...v1.15.6)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-04-14 13:06:34 -06:00
Roland
9b32874f74
Removing build directory after successful rpi build. 2024-03-16 19:59:07 -06:00
Roland
a665677ecc
Adding more lower-quality video formats to download when no other is available. Getting video ffprobe json when downloading. 2024-03-16 19:58:58 -06:00
Roland
c8e93f84aa
Changing zim label color when results are found, this helps the user find their results faster. 2024-03-16 19:58:12 -06:00
Roland
4c647241d6
Removing unused hook. 2024-03-16 19:57:43 -06:00