Commit graph

111 commits

Author SHA1 Message Date
Roland
38de2f9b40
Moving HTTP kiwix/help services to 9085/9086 ports. Nginx will serve HTTPS proxy for kiwix/help services at the old ports. Modifying apache2 to use HTTPS to serve map.
Using new https_proxy docker container to serve HTTPS for zim, map and help.
2024-06-12 21:38:51 -06:00
Roland
86355b664d
Using older version of single-file-cli to avoid error. 2024-05-14 20:29:57 -06:00
Roland
d0c9bec7f4
Modifying singlefile_to_archive to accept file list in stdin. 2024-05-07 09:41:48 -06:00
Roland
2924867f55
Bumping single-file-cli version for all systems. 2024-05-02 09:09:21 -06:00
Roland
ba2dd6dd11
Many fixes split out from the feature/unified-query branch. Installing diagnostic tools in the built images. Displaying video comment statistics. Echoing error when install.sh fails. 2024-04-14 13:13:30 -06:00
Roland
08f8454540
Simplifying scripts to find similarlly named videos. 2024-02-05 14:29:54 -07:00
Roland
6c87c25e07
Adding openstreetmap-carto to git safe directory list. 2023-11-25 13:02:55 -07:00
Roland
4425b4d8a3
Adding wrolpi-help to git safe directory. Help install failure should not break upgrade. 2023-11-23 16:22:46 -07:00
Roland
792e0c15cd
Upgrading help service when doing upgrade. 2023-11-23 16:20:28 -07:00
Roland
a7805745ab
Combining help service install into a script. 2023-11-23 15:49:01 -07:00
Roland
844bc9468c
Installing help during image build. Using wrolpi.local hostname for all links. 2023-11-22 15:08:29 -07:00
Roland
57262442bd
Installing WROLPi help environment for RPi and Debian. 2023-11-22 11:21:49 -07:00
Roland
15687e534a
Moving data from models to FileGroup.
* Ebook.creator -> FileGroup.author
* Video.viewed -> FileGroup.viewed
* Video.duration -> FileGroup.length
* Video.url -> FileGroup.url
* Archive.url -> FileGroup.url
2023-10-29 17:31:54 -06:00
Roland
ae9d188391
Adding FileGroup.published_date/author/etc. Creating script which converts a Singlefile to an Archive FileGroup files.
Parsing SingleFile datetime using dates.strpdate.

Adding timezone when no timezone info is available.

Installing python-dateutil to assist in handling diverse datetime strings.

Reworking refresh progress to use idempotency to display more accurate progress.  Only logging that files have been invalidated if they used to be indexed.

Clearing archives to force re-index.

Ignoring 'Unknown' author from PDF metadata. Using file_title when pdf metadata title is empty.
2023-10-23 18:09:08 -06:00
Roland
8230174fcd
Map initialization script will only ask to reset if the map database exists. 2023-10-09 12:20:51 -06:00
Roland
76212cf3de
Created script which searches for videos that have similar names, interacts with the user to choose which to delete. 2023-10-09 08:44:30 -06:00
Roland
7fd8a8527a
Reworking Debian install with real system. 2023-10-03 19:21:12 -06:00
Roland
6e0f9a999c
Combining install scripts into a new repair script. Removing create_db script in favor of repair script. 2023-10-03 12:15:29 -06:00
Roland
560b607492
Importing map as postgres user to avoid permissions issues. 2023-08-19 13:50:48 -06:00
Roland
3f5a8e79a0
Fixing sudoers file permissions. 2023-08-19 13:28:14 -06:00
Roland
4cc00a9cb1
Delaying reboot/shutdown with asyncio sleep to give API time to shut down. 2023-08-18 11:55:14 -06:00
Roland
5ffb8bee8d
Waiting for poweroff/reboot processes. Using full poweroff/reboot paths for sudoers files. 2023-08-18 11:32:12 -06:00
Roland
2537017039
Creating shutdown and restart buttons. 2023-08-17 20:07:02 -06:00
Roland
6791e88baf
Stopping/starting renderd during map import. Moving tile cache clearing to import script. 2023-08-17 11:49:19 -06:00
Roland
1e0e72fa24
Using clear_map_cache.sh script to handle clearing cache and restarting renderd after map import. 2023-08-16 14:34:20 -06:00
Roland
2821d6d7b8
Removing unused column. 2023-08-15 14:14:37 -06:00
Roland
e2535a49ee
Handling more errors during finding currupt videos. 2023-08-13 10:54:23 -06:00
Roland
bb0582b132
Only remove file if it exists. 2023-08-08 21:25:02 -06:00
Roland
e8e5b5727f
Creating Video.validated which is used by find_corrupt_videos.py to search. 2023-08-08 13:42:55 -06:00
Roland
2577455859
Adding option to ignore errors in find_and_convert_srt_to_vtt.py. 2023-08-04 08:36:30 -06:00
Roland
0475e0dc6d
Creating script which finds all SRT files and converts them to VTT. 2023-08-03 22:36:11 -06:00
Roland
36083200e6
Creating Video.ffprobe_json column which stores ffprobe information about the video file. Creating find_corrupt_videos.py script which automatically re-downloads videos which do not have both video and audio streams. 2023-08-03 21:40:25 -06:00
Roland
454891be15
Changing project ownership after upgrade. 2023-07-11 17:23:56 -06:00
Roland
7bba6555ca
Matching install scripts. 2023-07-11 16:54:46 -06:00
Roland
1f1564851d
Debian 11 does not have pi user. 2023-07-11 16:53:50 -06:00
Roland
1fff928d4e
Installing Kiwix packages and service in Raspberry Pi and Debian installer scripts. 2023-07-11 16:52:18 -06:00
Roland
03a2df217d
Zim/Kiwix (Wikipedia) feature
* A new zim module has been added, this module allows several things to interact with Zim files.
  * Allow searching of Zim files using libzim.
  * Allow downloading of Kiwix projects (wikipedia, wikibooks, etc) on a schedule which replaces the outdated files.
  * Creation of a new zim docker container which allows viewing of the Zim file contents.

* This commit also adds move/rename/mkdir features in the File Browser.
  * File tags are preserved when moving/renaming.
2023-07-10 21:30:40 -06:00
Roland
f764cee44e
Upgrade systemd file before building api. 2023-05-23 16:41:48 -06:00
Roland
ccb28db95c
Enabling Python optimization when running in Docker and systemd. 2023-05-23 16:31:10 -06:00
Roland
7ff2351dc5
Updating nginx configs during upgrade. 2023-05-01 13:00:23 -06:00
Roland
2b7f667699
Searching for wrolpi with colon to avoid catching non-wrolpi user. 2023-02-25 19:08:46 -07:00
Roland
6312a7eab1
Adding pgpass for wrolpi user. 2023-02-25 18:46:27 -07:00
Roland
eadc0a7537
Granting superuser to wrolpi during install so they can import maps. 2023-02-25 18:43:40 -07:00
Roland
550d6102fc
Adding delete todo. 2023-02-25 17:48:09 -07:00
Roland
ea114e6e97
Restoring ubuntu installer script which will forward install request to RPi OS installer. 2023-02-25 17:45:45 -07:00
Roland
a14ebf1909
Making upgrade executable. 2023-02-24 17:33:07 -07:00
Roland
dc9384ba4b
Calling second upgrade script so new upgrades can be pulled from git. 2023-02-24 17:31:08 -07:00
Roland
abb0b49315
Checking for icesheet table as current user.
Importing maps as wrolpi user, then changing ownership to _renderd.

Changing ownership of /opt/wrolpi as well.

Creating pgpass for wrolpi user in debian 11.

Install specific version of serve.

Not echoing the echo.

Updating cache directory in create_db.sh.

Use python binary to run db upgrade.

Install renderd.conf to /etc on RPi OS.

Fetching DC map from wrolpi.org to avoid broken daily PBFs.

Only get latest dc map if it doesn't exist.

carto switched again??

Changing mod_tile directory to /var/cache/renderd/tiles for RPi OS.

Copying renderd configs for RPi OS.

Installing postgres 13 for RPi OS map.

Changing title of feature matrix.

Moving download link up in readme.

Changing mod_tile to _renderd.

Using unix socket rather than host connection.

Getting openstreetmap-carto as _renderd user.

Assigning ownership of gis db to _renderd in reset_map.sh.

Creating _renderd db user.

Using _renderd to run renderd on debian 11.

Installing python modules that map requires globally.

Upgrading db using venv.

Installing nodejs which installs npm.

Install npm/node after other dependencies.

Updating apt so nodejs can be installed.

Upgrading PyYAML in new venv.

Installing pip via apt.

Including bash binary for portability.

Moving images link out of list.

Moving download up on Readme.

Removing map installation from readme.

Installing specific version of carto.

Creating venv for wrolpi project.  Using venv to install requirements and run wrolpi's main.py.

Logging upgrade script.

Including upgrade script in Upgrade readme.

Moving upgrade logic into separate script.  This is necessary so and repo update will take immediate effect on the upgrade.

Modifying and unifying Debian installation with RPi OS installation.
2023-02-24 16:16:13 -07:00
Roland
57ffe5f5c9
Removing map from default installation. The mantainer can run the map installation manually. 2023-02-22 21:38:26 -07:00
Roland
bb28d443a3
serve location changed in Debian 11. 2023-02-22 19:28:36 -07:00