wrolpi/wrolpi/__init__.py
Roland 58de8c7c5b
Upgrading Sanic and yt-dlp. Major changes occurred because Sanic changed how multiprocessing works.
Python 3.11 is now required, old versions were causing unpredictability in tests.  (Sanic does not yet
support 3.12)

Sanic has been upgraded to 23.6.0, which is the latest version that avoids this bug:
 https://github.com/sanic-org/sanic/issues/2921

New strategy for multiprocessing is to create all multiprocessing tools in one process, then fork
to other processes.  The previous strategy was to declare multiprocessing tools at the top of every
file, or wherever they were needed at import/creation.  Now all multiprocessing tools are attached to the
app.shared_ctx.  This means `api_app` is imported in many, many places.

This forced a change in how the DownloadManager works.  Previously, it would continually run
download workers which would pull downloads from a multiprocessing.Queue.  Now, a single worker checks
for new downloads and sends a Sanic signal.

Flags have been reworked to use the `api_app`.  I removed the `which` flag functionality because the
`which` are called at import and needed their own multiprocessing.Event.
2024-04-30 10:55:25 -06:00

22 lines
655 B
Python

import wrolpi.files.api # noqa Import from files so the blueprint is attached.
import wrolpi.scrape_downloader # noqa
BEFORE_STARTUP_FUNCTIONS = []
def before_startup(func: callable):
"""
Run a callable before startup of the WROLPi API. This will be called (and blocked on) once.
"""
if func not in BEFORE_STARTUP_FUNCTIONS:
BEFORE_STARTUP_FUNCTIONS.append(func)
return func
def after_startup(func: callable):
"""
Run a function after the startup of the WROLPi Sanic API. This will be run for each process!
"""
from wrolpi.api_utils import api_app
api_app.after_server_start(func)
return func