mirror of
https://github.com/lrnselfreliance/wrolpi.git
synced 2026-11-21 15:36:18 -05:00
ai: live-chat fixes from first real-model run
Three findings from running Qwen3-1.7B against the docker stack: the llm image lost libgomp when the build tools were removed (llama-server needs the OpenMP runtime); the Help prompt let the small model answer from memory instead of the docs, so it now requires search_help before any answer; and help search results called the slug "doc" while get_help_doc's argument is "slug", so the model invented slugs — the names now match. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
parent
6d14467046
commit
f49ae3aee5
5 changed files with 13 additions and 10 deletions
|
|
@ -6,7 +6,9 @@ RUN apt-get update && apt-get install -y curl ca-certificates
|
|||
# Build llama-server from the pinned release (single source of truth with native installs).
|
||||
COPY wrolpi/scripts/install_llama_cpp.sh /tmp/install_llama_cpp.sh
|
||||
RUN /tmp/install_llama_cpp.sh && rm /tmp/install_llama_cpp.sh \
|
||||
&& apt-get remove -y build-essential cmake && apt-get autoremove -y && apt-get clean
|
||||
&& apt-get remove -y build-essential cmake && apt-get autoremove -y \
|
||||
# llama-server needs the OpenMP runtime, which the build-tool cleanup just removed.
|
||||
&& apt-get install -y libgomp1 && apt-get clean
|
||||
|
||||
# The same startup scripts the native install uses.
|
||||
COPY scripts/start_llama_server.sh /opt/wrolpi/scripts/start_llama_server.sh
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue