ai: live-chat fixes from first real-model run

Three findings from running Qwen3-1.7B against the docker stack:
the llm image lost libgomp when the build tools were removed
(llama-server needs the OpenMP runtime); the Help prompt let the
small model answer from memory instead of the docs, so it now
requires search_help before any answer; and help search results
called the slug "doc" while get_help_doc's argument is "slug", so
the model invented slugs — the names now match.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
Roland 2026-08-27 12:21:44 -06:00
parent 6d14467046
commit f49ae3aee5
No known key found for this signature in database
GPG key ID: 1BA620CE6C9A4680
5 changed files with 13 additions and 10 deletions

View file

@ -6,7 +6,9 @@ RUN apt-get update && apt-get install -y curl ca-certificates
# Build llama-server from the pinned release (single source of truth with native installs).
COPY wrolpi/scripts/install_llama_cpp.sh /tmp/install_llama_cpp.sh
RUN /tmp/install_llama_cpp.sh && rm /tmp/install_llama_cpp.sh \
&& apt-get remove -y build-essential cmake && apt-get autoremove -y && apt-get clean
&& apt-get remove -y build-essential cmake && apt-get autoremove -y \
# llama-server needs the OpenMP runtime, which the build-tool cleanup just removed.
&& apt-get install -y libgomp1 && apt-get clean
# The same startup scripts the native install uses.
COPY scripts/start_llama_server.sh /opt/wrolpi/scripts/start_llama_server.sh