mirror of
https://github.com/lrnselfreliance/wrolpi.git
synced 2026-10-26 19:01:39 -04:00
9cb1414d7a
Three findings from running Qwen3-1.7B against the docker stack: the llm image lost libgomp when the build tools were removed (llama-server needs the OpenMP runtime); the Help prompt let the small model answer from memory instead of the docs, so it now requires search_help before any answer; and help search results called the slug "doc" while get_help_doc's argument is "slug", so the model invented slugs — the names now match. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
19 lines
828 B
Docker
19 lines
828 B
Docker
FROM debian:13
|
|
ENV DOCKER=true
|
|
|
|
RUN apt-get update && apt-get install -y curl ca-certificates
|
|
|
|
# Build llama-server from the pinned release (single source of truth with native installs).
|
|
COPY wrolpi/scripts/install_llama_cpp.sh /tmp/install_llama_cpp.sh
|
|
RUN /tmp/install_llama_cpp.sh && rm /tmp/install_llama_cpp.sh \
|
|
&& apt-get remove -y build-essential cmake && apt-get autoremove -y \
|
|
# llama-server needs the OpenMP runtime, which the build-tool cleanup just removed.
|
|
&& apt-get install -y libgomp1 && apt-get clean
|
|
|
|
# The same startup scripts the native install uses.
|
|
COPY scripts/start_llama_server.sh /opt/wrolpi/scripts/start_llama_server.sh
|
|
COPY wrolpi/scripts/read_config_value.sh /opt/wrolpi/wrolpi/scripts/read_config_value.sh
|
|
|
|
COPY docker/llm/entrypoint.sh /entrypoint.sh
|
|
|
|
ENTRYPOINT ["/entrypoint.sh"]
|