Commit graph

128 commits

Author SHA1 Message Date
Roland
581d5eaf6e
Adding toggle to Channel page to stop downloading comments for certain channels. 2025-03-01 18:23:29 -07:00
Roland
47d4d72bf8
Creating script which takes lat/long coordinates to download map tiles into the current directory. 2025-02-28 14:15:51 -07:00
Roland
531ec3d65e
Creating new /api/archive/upload which accepts a file from the SingleFile browser extension and converts it to an Archive. 2025-01-30 18:41:32 -07:00
Roland
036b12382e
Creating script which updates yt-dlp in the wrolpi venv to the latest available. 2025-01-23 17:46:37 -07:00
Roland
b49cedd62a
Forcing utf8 for map database. 2025-01-22 08:33:33 -07:00
Roland
bd599e1b2b
Fixing upgrade which deletes the wrong map blob. Fixing the port so the old map database is deleted. 2025-01-12 11:06:51 -07:00
Roland
af5d4dfd51
Disabling JIT for map database as recommended by mod_tile because of excess memory usgae. 2025-01-11 11:06:01 -07:00
Roland
8e4d173791
Converting map blob to use "custom" postgres dump format so restore can use multiple threads. Renaming map db blob from gis-map.dump.gz to map-db-gis.dump. 2025-01-02 12:04:03 -07:00
Roland
7324e83626
Creating script which migrates map database to new database for custom niceness. 2025-01-01 16:41:21 -07:00
Roland
5621d47309
Video downloads have many more options. Downloads are migrated.
Storing video settings in session storage to help user start downloads consistently.

Applying channel tag name to new channels when download videos or channels.

Initializing map tiles when importing and resetting map.
2024-11-28 09:48:57 -07:00
Roland
45167e4f32
A Channel can be tagged with a single Tag. The Channel can be moved into a Tag Directory according to the config. 2024-10-16 18:56:19 -06:00
Roland
2b8ef79561
Initializing git submodules for dev environment. 2024-10-16 18:56:18 -06:00
Roland
a98aebfdda
A video that is uploaded is attached to its Channel. Saving Channels config with both download url and frequency in case downloads config is corrupted. 2024-10-16 18:56:11 -06:00
Roland
218fb3e760
Replacing Tag names with escaped tag names to avoid errors in Tags Directory. 2024-10-16 18:56:10 -06:00
Roland
a068273beb
Updating wrolpi-help commit. Forcing re-install of mkdocs because of navbar bug. 2024-10-16 18:56:07 -06:00
Roland
cdc73d9d16
Trimming video file name to avoid error when file name is too long. 2024-10-16 18:55:52 -06:00
Roland
50d95dad19
Channels now have Channel.channel_downloads. A Channel can have many Downloads. 2024-10-16 18:55:46 -06:00
Roland
38de2f9b40
Moving HTTP kiwix/help services to 9085/9086 ports. Nginx will serve HTTPS proxy for kiwix/help services at the old ports. Modifying apache2 to use HTTPS to serve map.
Using new https_proxy docker container to serve HTTPS for zim, map and help.
2024-06-12 21:38:51 -06:00
Roland
86355b664d
Using older version of single-file-cli to avoid error. 2024-05-14 20:29:57 -06:00
Roland
d0c9bec7f4
Modifying singlefile_to_archive to accept file list in stdin. 2024-05-07 09:41:48 -06:00
Roland
2924867f55
Bumping single-file-cli version for all systems. 2024-05-02 09:09:21 -06:00
Roland
ba2dd6dd11
Many fixes split out from the feature/unified-query branch. Installing diagnostic tools in the built images. Displaying video comment statistics. Echoing error when install.sh fails. 2024-04-14 13:13:30 -06:00
Roland
08f8454540
Simplifying scripts to find similarlly named videos. 2024-02-05 14:29:54 -07:00
Roland
6c87c25e07
Adding openstreetmap-carto to git safe directory list. 2023-11-25 13:02:55 -07:00
Roland
4425b4d8a3
Adding wrolpi-help to git safe directory. Help install failure should not break upgrade. 2023-11-23 16:22:46 -07:00
Roland
792e0c15cd
Upgrading help service when doing upgrade. 2023-11-23 16:20:28 -07:00
Roland
a7805745ab
Combining help service install into a script. 2023-11-23 15:49:01 -07:00
Roland
844bc9468c
Installing help during image build. Using wrolpi.local hostname for all links. 2023-11-22 15:08:29 -07:00
Roland
57262442bd
Installing WROLPi help environment for RPi and Debian. 2023-11-22 11:21:49 -07:00
Roland
15687e534a
Moving data from models to FileGroup.
* Ebook.creator -> FileGroup.author
* Video.viewed -> FileGroup.viewed
* Video.duration -> FileGroup.length
* Video.url -> FileGroup.url
* Archive.url -> FileGroup.url
2023-10-29 17:31:54 -06:00
Roland
ae9d188391
Adding FileGroup.published_date/author/etc. Creating script which converts a Singlefile to an Archive FileGroup files.
Parsing SingleFile datetime using dates.strpdate.

Adding timezone when no timezone info is available.

Installing python-dateutil to assist in handling diverse datetime strings.

Reworking refresh progress to use idempotency to display more accurate progress.  Only logging that files have been invalidated if they used to be indexed.

Clearing archives to force re-index.

Ignoring 'Unknown' author from PDF metadata. Using file_title when pdf metadata title is empty.
2023-10-23 18:09:08 -06:00
Roland
8230174fcd
Map initialization script will only ask to reset if the map database exists. 2023-10-09 12:20:51 -06:00
Roland
76212cf3de
Created script which searches for videos that have similar names, interacts with the user to choose which to delete. 2023-10-09 08:44:30 -06:00
Roland
7fd8a8527a
Reworking Debian install with real system. 2023-10-03 19:21:12 -06:00
Roland
6e0f9a999c
Combining install scripts into a new repair script. Removing create_db script in favor of repair script. 2023-10-03 12:15:29 -06:00
Roland
560b607492
Importing map as postgres user to avoid permissions issues. 2023-08-19 13:50:48 -06:00
Roland
3f5a8e79a0
Fixing sudoers file permissions. 2023-08-19 13:28:14 -06:00
Roland
4cc00a9cb1
Delaying reboot/shutdown with asyncio sleep to give API time to shut down. 2023-08-18 11:55:14 -06:00
Roland
5ffb8bee8d
Waiting for poweroff/reboot processes. Using full poweroff/reboot paths for sudoers files. 2023-08-18 11:32:12 -06:00
Roland
2537017039
Creating shutdown and restart buttons. 2023-08-17 20:07:02 -06:00
Roland
6791e88baf
Stopping/starting renderd during map import. Moving tile cache clearing to import script. 2023-08-17 11:49:19 -06:00
Roland
1e0e72fa24
Using clear_map_cache.sh script to handle clearing cache and restarting renderd after map import. 2023-08-16 14:34:20 -06:00
Roland
2821d6d7b8
Removing unused column. 2023-08-15 14:14:37 -06:00
Roland
e2535a49ee
Handling more errors during finding currupt videos. 2023-08-13 10:54:23 -06:00
Roland
bb0582b132
Only remove file if it exists. 2023-08-08 21:25:02 -06:00
Roland
e8e5b5727f
Creating Video.validated which is used by find_corrupt_videos.py to search. 2023-08-08 13:42:55 -06:00
Roland
2577455859
Adding option to ignore errors in find_and_convert_srt_to_vtt.py. 2023-08-04 08:36:30 -06:00
Roland
0475e0dc6d
Creating script which finds all SRT files and converts them to VTT. 2023-08-03 22:36:11 -06:00
Roland
36083200e6
Creating Video.ffprobe_json column which stores ffprobe information about the video file. Creating find_corrupt_videos.py script which automatically re-downloads videos which do not have both video and audio streams. 2023-08-03 21:40:25 -06:00
Roland
454891be15
Changing project ownership after upgrade. 2023-07-11 17:23:56 -06:00