wrolpi/modules/ai
Roland 49ff97c3ad
ai: list custom GGUF files in the Manage tab
A GGUF copied into ai/models/ by hand could be activated by editing
ai.yaml, but never appeared in the Manage tab because the catalog
endpoint only returned CDN/bundled models. The Active Model dropdown
builds from downloaded models, so a custom file was unselectable.

The catalog endpoint now merges any on-disk *.gguf that is not in the
catalog as a `custom` tier model with its real size and no URL. It is
discovered on every request, so a file appears the next time the page
loads; the file refresh is not involved and does not index models.

Catalog models are never duplicated and in-progress .tmp downloads are
ignored. Custom rows read "On disk" and the hint explains the copy-in
path, the tool-calling requirement, and the context_size fallback.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-24 13:30:00 -06:00
..
test ai: list custom GGUF files in the Manage tab 2026-09-24 13:30:00 -06:00
__init__.py ai: package llama-server for all three deployments, with idle unload 2026-09-13 20:10:16 -06:00
agent.py ai: the /api/chat agent loop — SSE streaming, modes, tool execution 2026-09-13 20:10:16 -06:00
api.py ai: list custom GGUF files in the Manage tab 2026-09-24 13:30:00 -06:00
catalog.py ai: ground answers in a live library map, budget the context 2026-09-13 20:10:17 -06:00
chat.py ai: ground answers in a live library map, budget the context 2026-09-13 20:10:17 -06:00
config.py ai: ground answers in a live library map, budget the context 2026-09-13 20:10:17 -06:00
conftest.py ai: ai.yaml config, model catalog, and the GGUF downloader 2026-09-13 20:10:15 -06:00
context.py ai: kind-generic search_files / get_file / read_content 2026-09-13 20:10:18 -06:00
controller_client.py ai: package llama-server for all three deployments, with idle unload 2026-09-13 20:10:16 -06:00
downloader.py ai: ai.yaml config, model catalog, and the GGUF downloader 2026-09-13 20:10:15 -06:00
errors.py ai: system endpoints — aggregate status, services, logs, disks 2026-09-13 20:10:15 -06:00
help_docs.py ai: live-chat fixes from first real-model run 2026-09-13 20:10:16 -06:00
lib.py ai: research mode runs on the compact tool catalog 2026-09-13 20:10:18 -06:00
modes.py ai: research mode runs on the compact tool catalog 2026-09-13 20:10:18 -06:00
schema.py ai: research mode runs on the compact tool catalog 2026-09-13 20:10:18 -06:00
service.py ai: package llama-server for all three deployments, with idle unload 2026-09-13 20:10:16 -06:00