wrolpi/requirements.txt
lrnselfreliance 8edace08bd
Python packages install from hash-locked requirements; yt-dlp still floats (#913)
* Python packages install from hash-locked requirements; yt-dlp still floats

Every pip install trusted PyPI over TLS: requirements.txt pins only top-level versions
(some with >=), the controller's are almost all >=, and dependencies were never pinned, so
a forged certificate (as the eMudhra key compromise allowed) could change code in the API,
the controller, or the archive container.  scripts/lock_requirements.sh generates a
universal, hash-locked .lock beside each requirements.txt, and
install_python_requirements.sh installs it with --require-hashes at every site.  yt-dlp is
left out of the lock and upgraded afterwards so devices still get YouTube fixes; its
dependencies are locked.  The unpinned `pip install --upgrade pip` steps are gone.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* The unhashed yt-dlp install cannot replace locked packages, and nothing builds from source

Review of #913 found two holes.  The yt-dlp step ran without --no-deps, so pip's
only-if-needed strategy would still fetch an unhashed dependency whenever yt-dlp's metadata
asked for a version the lock did not install.  And srt is published only as a source
archive, whose build installed setuptools with hash checking off on every install.

The yt-dlp step now uses --no-deps (its dependencies come only from the lock), both steps
are retried as the image builds did before, and installs and locks are wheels-only.  srt
3.5.3 is vendored unmodified as wrolpi/vendor/srt.py (MIT), verified against the sdist
hash the lock pinned; webvtt-py's SRT reader rejects WROLPi's own test file, so it is not
a replacement.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 12:00:39 -07:00

43 lines
1.1 KiB
Text

Pillow==13.0.0
PyYAML==6.0.3
SQLAlchemy==2.0.54
aiohttp==3.14.4
alembic==1.20.0
beautifulsoup4==4.15.0
cachetools==7.2.1
# yt-dlp, requests and curl-cffi trust certifi's bundle, not the system store. 2026.10.19 removes
# the root of the eMudhra intermediates whose private keys are recoverable.
certifi>=2026.10.19
cryptography==50.0.2
ebooklib==0.20
feedparser==6.0.14
jc==1.26.0
libzim==3.13.1
mock==5.2.0
psutil==7.2.2
pydantic>=2.0.0
PyMuPDF>=1.28.2
pytest-asyncio==1.4.0
# pytest.ini sets `timeout = 30` and asks that it not be removed, but this was never declared
# here -- so on any machine without it, and in CI, which installs only this file, the option was
# unknown and the timeout never applied. A hung test then runs until the CI job itself is
# killed, with no indication of which test hung.
pytest-timeout==2.4.0
pytest-xdist==3.8.0
pytest==9.1.1
py7zr>=1.1.3
python-docx==1.2.0
python-dotenv==1.2.4
python-magic~=0.4.27
pytz==2026.5
rarfile>=4.5
sanic-ext==25.12.0
sanic-testing==24.6.0
sanic==25.12.1
secretstorage==3.5.0
selenium==4.50.0
tqdm==4.70.1
vininfo[cli]==1.11.0
webvtt-py==0.5.1
yt-dlp[default,curl-cffi]>=2026.08.19
yt-dlp-ejs>=0.8.0