# Qwen 3.8 on llama.cpp (pbx-node3)

The GPU box (`pbx-node3`) serves Qwen 3.8 through llama.cpp.

Working launch line (verified 2026-08):

    ./llama-server -m qwen3.8-30b-a3b-instruct.Q8_0.gguf \
      -c 32768 -ngl 99 --mlock --threads 12 -sm layer \
      --cache-type-k q8_0 --cache-type-v q8_0 \
      --jinja --port 18180

- Context 32768, KV cache q8_0/q8_0, prompt cache persisted to
  `/srv/llamacpp/cache`.
- First-token target is under 400 ms; sustained throughput about 28 tok/s.
- Do not add `-ctk f16` — it doubled VRAM usage with no quality gain.