Commit graph

188 commits

Author SHA1 Message Date
Roland
6791e88baf
Stopping/starting renderd during map import. Moving tile cache clearing to import script. 2023-08-17 11:49:19 -06:00
Roland
1e0e72fa24
Using clear_map_cache.sh script to handle clearing cache and restarting renderd after map import. 2023-08-16 14:34:20 -06:00
Roland
2821d6d7b8
Removing unused column. 2023-08-15 14:14:37 -06:00
Roland
e2535a49ee
Handling more errors during finding currupt videos. 2023-08-13 10:54:23 -06:00
Roland
bb0582b132
Only remove file if it exists. 2023-08-08 21:25:02 -06:00
Roland
e8e5b5727f
Creating Video.validated which is used by find_corrupt_videos.py to search. 2023-08-08 13:42:55 -06:00
Roland
2577455859
Adding option to ignore errors in find_and_convert_srt_to_vtt.py. 2023-08-04 08:36:30 -06:00
Roland
0475e0dc6d
Creating script which finds all SRT files and converts them to VTT. 2023-08-03 22:36:11 -06:00
Roland
36083200e6
Creating Video.ffprobe_json column which stores ffprobe information about the video file. Creating find_corrupt_videos.py script which automatically re-downloads videos which do not have both video and audio streams. 2023-08-03 21:40:25 -06:00
Roland
454891be15
Changing project ownership after upgrade. 2023-07-11 17:23:56 -06:00
Roland
7bba6555ca
Matching install scripts. 2023-07-11 16:54:46 -06:00
Roland
1f1564851d
Debian 11 does not have pi user. 2023-07-11 16:53:50 -06:00
Roland
1fff928d4e
Installing Kiwix packages and service in Raspberry Pi and Debian installer scripts. 2023-07-11 16:52:18 -06:00
Roland
03a2df217d
Zim/Kiwix (Wikipedia) feature
* A new zim module has been added, this module allows several things to interact with Zim files.
  * Allow searching of Zim files using libzim.
  * Allow downloading of Kiwix projects (wikipedia, wikibooks, etc) on a schedule which replaces the outdated files.
  * Creation of a new zim docker container which allows viewing of the Zim file contents.

* This commit also adds move/rename/mkdir features in the File Browser.
  * File tags are preserved when moving/renaming.
2023-07-10 21:30:40 -06:00
Roland
f764cee44e
Upgrade systemd file before building api. 2023-05-23 16:41:48 -06:00
Roland
ccb28db95c
Enabling Python optimization when running in Docker and systemd. 2023-05-23 16:31:10 -06:00
Roland
7ff2351dc5
Updating nginx configs during upgrade. 2023-05-01 13:00:23 -06:00
Roland
2b7f667699
Searching for wrolpi with colon to avoid catching non-wrolpi user. 2023-02-25 19:08:46 -07:00
Roland
6312a7eab1
Adding pgpass for wrolpi user. 2023-02-25 18:46:27 -07:00
Roland
eadc0a7537
Granting superuser to wrolpi during install so they can import maps. 2023-02-25 18:43:40 -07:00
Roland
550d6102fc
Adding delete todo. 2023-02-25 17:48:09 -07:00
Roland
ea114e6e97
Restoring ubuntu installer script which will forward install request to RPi OS installer. 2023-02-25 17:45:45 -07:00
Roland
a14ebf1909
Making upgrade executable. 2023-02-24 17:33:07 -07:00
Roland
dc9384ba4b
Calling second upgrade script so new upgrades can be pulled from git. 2023-02-24 17:31:08 -07:00
Roland
abb0b49315
Checking for icesheet table as current user.
Importing maps as wrolpi user, then changing ownership to _renderd.

Changing ownership of /opt/wrolpi as well.

Creating pgpass for wrolpi user in debian 11.

Install specific version of serve.

Not echoing the echo.

Updating cache directory in create_db.sh.

Use python binary to run db upgrade.

Install renderd.conf to /etc on RPi OS.

Fetching DC map from wrolpi.org to avoid broken daily PBFs.

Only get latest dc map if it doesn't exist.

carto switched again??

Changing mod_tile directory to /var/cache/renderd/tiles for RPi OS.

Copying renderd configs for RPi OS.

Installing postgres 13 for RPi OS map.

Changing title of feature matrix.

Moving download link up in readme.

Changing mod_tile to _renderd.

Using unix socket rather than host connection.

Getting openstreetmap-carto as _renderd user.

Assigning ownership of gis db to _renderd in reset_map.sh.

Creating _renderd db user.

Using _renderd to run renderd on debian 11.

Installing python modules that map requires globally.

Upgrading db using venv.

Installing nodejs which installs npm.

Install npm/node after other dependencies.

Updating apt so nodejs can be installed.

Upgrading PyYAML in new venv.

Installing pip via apt.

Including bash binary for portability.

Moving images link out of list.

Moving download up on Readme.

Removing map installation from readme.

Installing specific version of carto.

Creating venv for wrolpi project.  Using venv to install requirements and run wrolpi's main.py.

Logging upgrade script.

Including upgrade script in Upgrade readme.

Moving upgrade logic into separate script.  This is necessary so and repo update will take immediate effect on the upgrade.

Modifying and unifying Debian installation with RPi OS installation.
2023-02-24 16:16:13 -07:00
Roland
57ffe5f5c9
Removing map from default installation. The mantainer can run the map installation manually. 2023-02-22 21:38:26 -07:00
Roland
bb28d443a3
serve location changed in Debian 11. 2023-02-22 19:28:36 -07:00
Roland
fcf98b402b
Carto location has changed in Debian 11. 2023-02-22 19:17:24 -07:00
Roland
e91d321bfd
Changing ownership of geometry_columns to renderd user. 2023-02-09 10:33:25 -07:00
Roland
81d80238be
Fixing changes before merge.
Moving FilesRefreshButton and DirectoryRefreshButton out of browser file.

Moving file fetching tino FileBrowser.

Removing sub-folders from Files display when any parent folder is clicked.

Using closed captioning for vtt/srt file icon.

Using my own react-semantic-toasts-2 to use toasts in Node 18.

Fixing bug where more than the last page was displayed.

Upgrading yt-dlp.

Fixing sub-folder file selection.

Adding rowKey to SortableTable to give React a key for each row.

Renaming key to path.

Removing duplicate urls.

Unifying file modals.

Displaying modals for image and text files.

Handling refresh loading in FileBrowser.  Creating refreshing_directory flag.

Removing accidental commit.

Sorting by url_count.

Using SortableTable on Domains page.

Using SortableTable for Channels page.

Created new FileBrowser which allows browsing of files in the media directory.

Using Node 18 in pi-gen.

Creating new FileBrowser to replace outdated react-keyed-file-browser.

Returning mimetype with file list.

Do not display 'Do not download' on Channel download in Dashboard.

Allowing null channel download frequency so user can stop downloading a channel.

Bumping version for Node 18.

Using my own semantic-ui-offline to avoid pulling Google fonts.

Upgrading app docker container to use Node 18.  This requires the removal of several npm packages.  File browser will require re-write.  It now pulls fonts from Google, this will need to be fixed.

Testing DownloadsToggle click.

Testing trinary states of DownloadsToggle.

Installing @testing-library/user-event for testing App.
2023-02-08 21:18:51 -07:00
Roland
e482c7a88f
Use NetworkManager for hotspot. Use _renderd user to import maps. 2023-01-18 12:51:21 -07:00
Roland
7904f1e11d
_renderd user is required for renderd. Providing wrolpi user the _renderd password. 2023-01-18 08:57:02 -07:00
Roland
c7e9c6f23b
Converting pi-gen map to use wrolpi user. 2023-01-17 20:15:19 -07:00
Roland
c700e10002
Restore map db dump using _renderd user. 2023-01-16 19:47:13 -07:00
Roland
4c5b15fadb
Using builtin _renderd user for map. 2023-01-16 16:45:02 -07:00
Roland
e70c748603
Making create_db.sh executable. 2023-01-16 11:08:59 -07:00
Roland
838b4dd185
Using pi-gen to create wrolpi raspberry image. 2023-01-16 11:05:27 -07:00
Roland
a63b51e572
Install serve version 12. 2022-12-29 15:32:23 -07:00
Roland
7b71554ad7
Installing global npm packages in one command. 2022-12-28 20:05:39 -07:00
Roland
a9560992c5
Install single-file, pip, readability as background tasks. 2022-12-28 19:54:40 -07:00
Roland
3ea5b62865
Installing single-file-cli instead of single-file. This is to avoid ssh issue with github. 2022-12-28 19:36:33 -07:00
Roland
5cbea1ba15 Fixing bug in debian install interpreter line. 2022-12-20 14:47:02 -07:00
Roland
d0d69519cd
Bumping version for new feature.
Skipping video epoch test on circleci.

Created script which finds and cleans up (renames/deletes) orphaned video meta files.

Reworking orphaned video query, some video files were leaking through.

Modifying File table to allow finding of orphaned video files.

Extracting epoch from video info_json for more accurate upload_date.

Extracting epoch from video info_json for more accurate upload_date.
2022-12-07 18:15:28 -07:00
Roland
427ba5e9b6
Generating WebVTT captions instead of SRT for display on VideoPage. 2022-11-30 18:27:03 -07:00
Roland
9c3809d751
Created script which generates srt subtitle files after transcribing videos. 2022-11-30 17:49:20 -07:00
Roland
55f0de6112
Installing single-file globally. 2022-11-16 21:03:35 -07:00
Roland
ad7e68367f
Changing /opt/openstreetmap-carto ownership before fetching during install. 2022-11-16 18:55:50 -07:00
Roland
a17eb6559e
Simplifying map init script by using full path to dc map. 2022-11-14 15:42:39 -07:00
Roland
836c139abd
Using latest dc map because old ones are cleaned up quickly. I had used the specific day to avoid errors in latest. 2022-11-14 15:37:11 -07:00
Roland
61d2ffde36
Starting renderd after reset. 2022-11-08 22:42:51 -07:00