Commit graph

426 commits

Author SHA1 Message Date
lrnselfreliance
0cd08b1950
Merge pull request #138 from lrnselfreliance/dependabot/pip/sanic-21.12.2
Bump sanic from 21.12.1 to 21.12.2
2022-08-06 12:51:18 -06:00
dependabot[bot]
49ef463c71
Bump sanic from 21.12.1 to 21.12.2
Bumps [sanic](https://github.com/sanic-org/sanic) from 21.12.1 to 21.12.2.
- [Release notes](https://github.com/sanic-org/sanic/releases)
- [Changelog](https://github.com/sanic-org/sanic/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/sanic-org/sanic/compare/v21.12.1...v21.12.2)

---
updated-dependencies:
- dependency-name: sanic
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-08-06 05:59:11 +00:00
Roland
3bfbaa4c22
Fixing bug where new downloads may not refresh without a next_download. 2022-07-23 16:12:28 -06:00
lrnselfreliance
42a9dc4c7b
Merge pull request #136 from lrnselfreliance/feature/multi-domain-download
DownloadManager uses multiple workers to download domains in parallel.
2022-07-22 16:38:21 -06:00
Roland
b6b04f2739
Removing unused code. Updating comments.
Removing timeout.  Updating tests now that downloads work.

Bumping version for async downloads.

Downloads run asynchronously.  Using aiohttp to make archive http request so ArchiveDownloader.do_download can be asynchronous.

Removing session for create_download(s) usages.

Reworkingk create_downloads to use optional_session.

Canceling download workers after tests and when stopping the manager.

All tests passing.

Tests pass!

Downloader tests pass.

DownloadManager uses multiple workers to download domains in parallel.
2022-07-22 16:35:42 -06:00
Roland
4cc7ef907f
Ignoring live chat when downloading videos. 2022-07-06 17:44:37 -06:00
lrnselfreliance
1c7d01f2fd
Merge pull request #135 from lrnselfreliance/feature/testing-status
Adding minimum tests for status functions and page.
2022-06-30 16:28:48 -06:00
Roland
2cc4c8a1e0
Testing for percent in circleci. 2022-06-30 16:26:26 -06:00
Roland
9270c5a79a
Removing assertion for circleci. 2022-06-30 16:25:34 -06:00
Roland
b411df1d1d
Adding minimum tests for status functions and page. 2022-06-30 16:22:57 -06:00
lrnselfreliance
8c72ae468a
Merge pull request #134 from lrnselfreliance/feature/status-page
Feature/status page
2022-06-30 16:04:39 -06:00
Roland
a1a444934e
Updating timeout to match new timeout logic.
Logging timeout.  Simplifying timeout logic.

Updating yt-dlp.

Bumping version for status page.

Ignoring /etc for docker.

Using top instead of custom script.

Warning when temperature file does not exist.

Handling when CPU files are not available.

Using swapping drive availablility for size.  Reworking page format.

Creating wrolpi status page.
2022-06-30 16:02:38 -06:00
Roland
59b9f3f81e
Using which() to locate ffmpeg. 2022-06-29 17:32:28 -06:00
Roland
862b12019b
Ignoring dot directories when importing modules. Raising error when ffprobe is not installed. 2022-06-29 17:27:43 -06:00
Roland
f3b61f8c18
Modifying OTP pad to match printer page. 2022-06-29 11:25:07 -06:00
Roland
e774f81869
Removing duplicate try/excepts in ChannelDownloader. 2022-06-28 12:49:11 -06:00
Roland
c772b57ddb
Returning all urls from a playlist, unless they're already downloaded. Changing all which() calls to contain BIN for clarity. 2022-06-28 10:09:35 -06:00
Roland
01c7f0716b
Bumping version for latex/magix removal. 2022-06-26 16:34:38 -06:00
Roland
f639e01951
Removing Latex as dependency. Using browser to convert OTP pads into printable documents. 2022-06-26 16:27:56 -06:00
Roland
776ac7edb0
Removing python-magic requirement in favor of file command. 2022-06-26 16:16:45 -06:00
Roland
fa83728f52
Including process logs in video result. Upgrading yt-dlp. 2022-06-26 15:45:45 -06:00
Roland
d617c88343
Increasing file size column to bigint to allow for larger files. 2022-06-22 17:36:49 -06:00
Roland
172e45f479
Adding sudo to chown commands. 2022-06-22 17:36:28 -06:00
Roland
58835ce356
Hotspot device can be changed. 2022-06-17 14:25:24 -06:00
Roland
6a94ffd0b2
A user can start a download even if the URL is in the skip list 2022-06-17 13:52:15 -06:00
Roland
089faa2b76
Fixing error when timeout was None. 2022-06-15 09:41:19 -06:00
lrnselfreliance
3894b2ba41
Merge pull request #133 from lrnselfreliance/feature/download-timeout
Feature/download timeout
2022-06-14 20:48:28 -06:00
Roland
3efd47d004
Global timeout can be set in the config and UI.
Downloaders can specify a process timeout.
2022-06-14 20:45:34 -06:00
Roland
0179beebea
Updating rss feed bozo error to use more common wording.g 2022-06-08 18:59:18 -06:00
lrnselfreliance
afa515a8d9
Merge pull request #132 from lrnselfreliance/feature/rss-downloader
Feature/rss downloader
2022-06-08 12:26:22 -06:00
Roland
ff379185fe
Adding config fixture to download manager fixture to avoid calling both in every test. 2022-06-08 12:21:59 -06:00
Roland
f14a230bc6
RSSDownloader can schedule downloads for other Downloaders using sub_downloader.
RSS download can be submitted in UI.

Checking if entry has link.

A video playlist can be downloaded.

Passing sub_downloader when submitting RSS feed.

Adding Archive downloader button.

Playlists need more info.

Removing expunge, it causes errors elsewhere.  Fixing tests.

Showing errors on recurring downloads.  Ignoring CharacterEncodingOverride bozo error for rss feed.

Changing download button order.

Fixing bug where channel attributes were unavailable after session.  Simplifying video format selection.

Calling validate_video in Video.validate() to avoid duplicate code.

Adding more frequent downloads for RSS Feeds.

DownloadManager skips downloads in it's list.

Renaming get_next_download to more clear calculate_next_download.

Stopping download manager when server is shutting down.

Not shutting down downloads during tests, not all tests use downloads.

Making methods static.
2022-06-08 11:56:42 -06:00
Roland
f2d57fcb23
Reformatting. 2022-05-19 21:38:55 -06:00
Roland
530f317a37
Adding helpful log notes to 50x.html. Suggesting changing media directory permissions after install. 2022-05-19 21:33:42 -06:00
Roland
ac4b029721
Bumping yt-dlp version. 2022-05-19 11:49:36 -06:00
Roland
8f62cb895f
Don't process channel downloads. 2022-05-18 19:58:21 -06:00
Roland
25e638ed10
Showing loader when saving settings. Adding HelpPopup when hotspot and power-save are disabled. 2022-05-18 19:43:25 -06:00
Roland
c681c500e8
Checking for corruption in bytes to avoid unicode error. 2022-05-18 18:36:12 -06:00
Roland
df72735289
Adding interactive shell to main. 2022-05-18 17:48:44 -06:00
Roland
dd07236834
Checking for video corruption. Processing video when preparing filname to avoid corrupt videos. 2022-05-18 17:24:50 -06:00
Roland
0c98187276
Adding wrolpi directory to global safe directory. 2022-05-18 08:20:05 -06:00
Roland
85bf9b2d65
Updating Readme Ubuntu installation link. 2022-05-17 16:20:10 -06:00
lrnselfreliance
0765890b8b
Feature/127 archive UI rework (#131)
* Archives have their own page.  Delete/etc buttons are moved into ArchivePage.

* Alternatives for an Archive are displayed in the ArchivePage.

* ArchiveDownloader returns the location.

* Removing color from Details button.

* Making Archive screenshot and title a link.

* Preserving next_download when updating a Channel.

* Removing button icons from Archive page.
2022-05-16 17:57:18 -06:00
Roland
2314c3462f
Forcing downloader selection. Adding link to downloads page near global Download button. 2022-05-10 22:53:33 -06:00
Roland
f9dd056cc9
Fixing error where all Videos of a Channel would be downloaded because upsert_video() did not update the correct record. 2022-05-10 22:44:59 -06:00
lrnselfreliance
051290ede2
Merge pull request #126 from lrnselfreliance/feature/download-result
VideoDownloader returns a DownloadResult.
2022-05-10 21:27:14 -06:00
Roland
785ad8274c
DownloadResult.try_again is not necessary.
Removing unused fixture in test.

Simplifying logic after download completes.  Removing unused download sorting method.

ChannelDownloader returns location.

Hiding View link when no location is provided.

Performing video upsert in try/except so any errors are attached to the Download.

Including stderr only.

Including logs when returning Downloader.process_runner.

Warning when extention is replaced.

Providing location link on Downloads page.  Showing error modal on errors that fail.

Handling empty URL strings on import.

Fixing channel download test.

Reworking how Channels schedule Video downloads.

Bumping version for DownloadResult.

Updating tests to use DownloadResult.

VideoDownloader returns a DownloadResult.
2022-05-10 21:20:36 -06:00
Roland
28e983a3b3
Moving TOC up in readme. 2022-05-03 11:13:29 -06:00
lrnselfreliance
c56a937b73
Merge pull request #125 from lrnselfreliance/feature/upgrade-readme
Adding upgrade instructions to Readme.
2022-05-03 11:12:14 -06:00
Roland
e59f0c059f
Including map volumes in upgrade instructions. 2022-05-03 11:07:48 -06:00