Commit graph

244 commits

Author SHA1 Message Date
Roland
44ebc876fa
Renaming examples to avoid grouping of pdf with ebooks. Reworking URLs for media files to avoid escaping url safe characters. 2023-03-29 13:46:39 -06:00
Roland
b481334e1a
Fixing bug with parsing video upload dates. 2023-03-29 08:53:01 -06:00
Roland
a7c4fd1119
Displaying progress bar during refresh. 2023-03-27 20:46:31 -06:00
Roland
b85d868a1b
Swapping tag config items, sorted by tag name first will make it easier to read. 2023-03-27 10:52:46 -06:00
Roland
6883a4734a
Not re-favoriting videos. 2023-03-27 10:27:18 -06:00
Roland
b5a9e45806
Increasing logging during refresh. Not setting channel_id in file_group.data in favor of using video.channel_id. 2023-03-27 10:02:47 -06:00
Roland
f3e2c0d7e8
Handling if data is empty in FileCard. 2023-03-25 21:06:15 -06:00
Roland
b1d0ddb5f2
Renaming local function to avoid confusion with library function. 2023-03-25 20:56:32 -06:00
Roland
0c96722a8b
Filtering videos by mimetype rather than model. 2023-03-25 20:56:14 -06:00
Roland
5615ce542d
Making example label a tag.
Tags can be created and deleted in UI.

Adding tag_file using id to avoid session error.

Using UTC in test.

Matching tag_names style in test.

Tag icon is displayed on file rows.

Archives, Videos and Files can be filtered by their tags.

Tags can be added and removed from UI.

Tags are displayed in VideoPlayer.

The tags of a file are returned in it's JSON.

Video favorites are converted to Favorite tag on channel config import.

Updating tests to match frontend usage.

PDF creator and modification time are displayed.

Reworking file search to use Video.__json__ for complex video relations.

Archives can be viewed.

Removing ebook.title.

Reworking alembic migration to be an upgrade rather than a replace.

Skipping test on circleci.

Clearing out video caption index only if extract_subtitles if off.

Channel tests pass.

Some video tests pass.

Missing videos can be found.  A video can be downloaded.

Orphaned files can be found.

Videos can be tagged.

Videos can be searched.

Videos can be modeled.

Converting some tests to use FileGroup.primary_path.

Adding archive and domains to alembic migration.

Testing cascading Archive titles.

Archives now uses FileGroup.

archive.lib tests pass.

Archive is partially converted to FileGroup.

Calculating FileGroup.primary file on refresh, rather than on select.

wrolpi tests pass.

Using FilesType to convert between str/pathlib.Path for FileGroup.files.

Using list of files in FileGroup.files instead of dictionary.

Storing files in dedicated FileGroup.files to avoid overwriting them.

Adding comment explaining CASE.

Not overwriting FileGroup.data on refresh if no change has been detected.

Removing File model in favor of FileGroup.data.

Adding typing to Files methods.

Files are indexed using the primary mimetype of the FileGroup.

files test_lib tests pass.

Removing file_group_file in favor of simple one-to-many relationship.

PDF files are indexed during refresh.

Adding Tag and TagFile to tag files with specific tags.

Only iterating when full_stem_ids has contents.

Testing that FileGroups are related to their Files.

Files and file_groups are created and linked.

Bump webpack from 5.75.0 to 5.76.1 in /app (#160)

Bumps [webpack](https://github.com/webpack/webpack) from 5.75.0 to 5.76.1.
- [Release notes](https://github.com/webpack/webpack/releases)
- [Commits](https://github.com/webpack/webpack/compare/v5.75.0...v5.76.1)

---
updated-dependencies:
- dependency-name: webpack
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-25 17:54:41 -06:00
Roland
b373992fed
Increasing archive file name character limit. 2023-02-27 14:42:58 -07:00
Roland
942a35e5d8
Resolving Channel download entries. Detecting and raising error when user has not specified exactly which video URL they want to download. 2023-02-21 15:12:45 -07:00
Roland
df79aa13b1
Handling when channel info json may not have channel_id. 2023-02-17 16:30:13 -07:00
Roland
a0df01f7b9
Saving channel config when source_id is fetched during channel import. 2023-02-17 16:00:44 -07:00
Roland
81d80238be
Fixing changes before merge.
Moving FilesRefreshButton and DirectoryRefreshButton out of browser file.

Moving file fetching tino FileBrowser.

Removing sub-folders from Files display when any parent folder is clicked.

Using closed captioning for vtt/srt file icon.

Using my own react-semantic-toasts-2 to use toasts in Node 18.

Fixing bug where more than the last page was displayed.

Upgrading yt-dlp.

Fixing sub-folder file selection.

Adding rowKey to SortableTable to give React a key for each row.

Renaming key to path.

Removing duplicate urls.

Unifying file modals.

Displaying modals for image and text files.

Handling refresh loading in FileBrowser.  Creating refreshing_directory flag.

Removing accidental commit.

Sorting by url_count.

Using SortableTable on Domains page.

Using SortableTable for Channels page.

Created new FileBrowser which allows browsing of files in the media directory.

Using Node 18 in pi-gen.

Creating new FileBrowser to replace outdated react-keyed-file-browser.

Returning mimetype with file list.

Do not display 'Do not download' on Channel download in Dashboard.

Allowing null channel download frequency so user can stop downloading a channel.

Bumping version for Node 18.

Using my own semantic-ui-offline to avoid pulling Google fonts.

Upgrading app docker container to use Node 18.  This requires the removal of several npm packages.  File browser will require re-write.  It now pulls fonts from Google, this will need to be fixed.

Testing DownloadsToggle click.

Testing trinary states of DownloadsToggle.

Installing @testing-library/user-event for testing App.
2023-02-08 21:18:51 -07:00
Roland
aa15f5db80
Updating Channels UI table to use iso datetime. 2022-12-29 09:58:29 -07:00
Roland
9dfaabdb9b
Not sending refresh events for channel downloads. 2022-12-29 09:36:24 -07:00
Roland
0152b8648e
Attaching Channel's info_json even if the download is a playlist. 2022-12-28 19:36:01 -07:00
Roland
95c8610df2
File.d_text is reformatted to break up long lines. 2022-12-27 15:41:55 -07:00
Roland
35145d0335
Searching for censored videos when refreshing a channel. 2022-12-26 11:30:28 -07:00
Roland
93f0e7494f
Creating Event and Flag systems. Events are used to send and display a toast to the App. Flags are used to signal if some action has been performed, or if a package is installed. 2022-12-23 16:04:09 -07:00
Roland
875f6f2606
Creating ebook details modal for ebook card. Linking to epub reader when possible in ebook card. 2022-12-19 10:40:01 -07:00
Roland
a322d1a0a9
Removing unnecessary flush. 2022-12-16 09:21:22 -07:00
Roland
3751ed7999
Reformatting files. 2022-12-14 19:11:11 -07:00
Roland
a149cc8f69
Reworking modelers to only fetch matching models once to avoid making many queries per group. 2022-12-14 18:52:42 -07:00
Roland
ff292b6e3f
Increasing Singlefile header size because some URLs may be very long. 2022-12-14 15:14:50 -07:00
Roland
cdc02ecaf2
Mocking apply_indexers because it is unecessary for this test. 2022-12-14 13:16:42 -07:00
Roland
9b048af7fd
Removing unused code. Matching use of style for file name parsing. 2022-12-14 10:33:11 -07:00
Roland
9ffe6ee3f6
Info JSON epoch is time of download, not time of upload. 2022-12-08 13:45:46 -07:00
Roland
d0d69519cd
Bumping version for new feature.
Skipping video epoch test on circleci.

Created script which finds and cleans up (renames/deletes) orphaned video meta files.

Reworking orphaned video query, some video files were leaking through.

Modifying File table to allow finding of orphaned video files.

Extracting epoch from video info_json for more accurate upload_date.

Extracting epoch from video info_json for more accurate upload_date.
2022-12-07 18:15:28 -07:00
Roland
8360e4fb82
Re-indexing video if its files change. 2022-11-30 18:36:22 -07:00
Roland
20860fdae8
Detecting more video caption files, indexing them. Only WebVTT captions are displayed on VideoPage. Creating Files tab on VideoPage which displays all files found for the video. 2022-11-30 18:26:38 -07:00
Roland
6a67883354
Remuxing video using yt-dlp to handle when output format is wrong. Checking for remuxed destination video file and using it. 2022-11-23 17:30:25 -07:00
Roland
c2d25f7717
Only generating video poster if no path or file exists. 2022-11-16 16:52:49 -07:00
Roland
053bc7eaeb
Updating test when videos are deleted. 2022-11-16 12:50:20 -07:00
Roland
003304046c
Commiting final deletion of video. 2022-11-15 13:03:26 -07:00
Roland
11bd59cec0
Changing Archive Sync to Update and Alternatives to History. 2022-11-14 15:42:57 -07:00
Roland
02124307e4
Downloads can be deleted. 2022-11-12 14:17:21 -07:00
Roland
cc80929723
Clearing out bad json file if it cannot be found. 2022-11-12 13:43:18 -07:00
Roland
2c6fdc42ad
Channel may not have a directory while testing. 2022-11-10 08:36:36 -07:00
Roland
83bd19d91f
Returned Video.censored when fetching video. 2022-11-10 08:21:54 -07:00
Roland
a0ad941425
Getting all channel properties during session. 2022-11-09 19:41:29 -07:00
Roland
be852e3d46
Fixing bug where empty destination would be coerced into 'None'. 2022-11-09 19:19:06 -07:00
Roland
ddb35448aa
Finding channel by destination directory if any. 2022-11-09 08:54:56 -07:00
Roland
f1bc29d76f
Adding feature where Videos can be downloaded to a destination directory. 2022-11-09 08:33:55 -07:00
Roland
1e1c8f0b85
ChannelDownloader will add itself to Download.Settings, so VideoDownloader can download to the channel if yt-dlp cannot find the channel. 2022-11-08 22:41:50 -07:00
Roland
456a83b8f4
Fixing when path stem's would sometimes not parse. 2022-11-05 19:31:30 -06:00
Roland
d2fbf12e26
Using worst-case-scenario for calculating map time-to-import. 2022-11-05 14:38:33 -06:00
Roland
66336e7ca5
Using worst-case-scenario for calculating map time-to-import. 2022-11-05 13:28:40 -06:00
Roland
6c2a5d723e
Downloads are saved to the download manager config. They are imported on startup. 2022-11-04 19:59:42 -06:00