LLM engines
reading engines…
window
all engines
no engines yet
sums only engines answering now
running
n/a
waiting
n/a
prompt tok/s
n/atok/s
decode tok/s
n/atok/s
total tokens
n/a
No engines configured
Set GUFO_BASE_URL (llama.cpp / gufo), VLLM_BASE_URL and/or RADIANCE_BASE_URL.
Prompt / prefill throughput
tok/sKV / prefix cache pressure
% in useSessions & queue
running vs waitingEvents
- loading…