wrolpi/docker/llm
Roland 9cb1414d7a
ai: live-chat fixes from first real-model run
Three findings from running Qwen3-1.7B against the docker stack:
the llm image lost libgomp when the build tools were removed
(llama-server needs the OpenMP runtime); the Help prompt let the
small model answer from memory instead of the docs, so it now
requires search_help before any answer; and help search results
called the slug "doc" while get_help_doc's argument is "slug", so
the model invented slugs — the names now match.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-09-24 14:09:55 -06:00
..
Dockerfile ai: live-chat fixes from first real-model run 2026-09-24 14:09:55 -06:00
entrypoint.sh ai: package llama-server for all three deployments, with idle unload 2026-09-24 14:09:54 -06:00