rt/wrolpi
1
0
Fork 0
mirror of https://github.com/lrnselfreliance/wrolpi.git synced 2026-10-26 19:01:39 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions

Ignoring worker count because each process has it's own worker. Limiting simultaneous downloads to 4.

Browse source
This commit is contained in:
Roland 2023-04-02 12:39:54 -06:00
parent c24353edf2
commit c26e47a55d
No known key found for this signature in database
GPG key ID: 9D6DBD3ACF11AB93
1 changed files with 3 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

4
wrolpi/downloader.py
View file

@ -591,7 +591,9 @@ class DownloadManager:
# Don't queue downloads when disabled.
return
if len(self.data['processing_domains']) >= len(self.workers):
if (domains := len(self.data['processing_domains'])) >= 4:
self.log_debug(
f'Unable to queue downloads because there are more domains than workers: {domains} >= 4')
return
# Find download whose domain isn't already being downloaded.