ducoterra
48bc92b9af
Build and Push Container / build-and-push (push) Successful in 38s
Single-file FastAPI proxy plus a no-CDN vanilla-JS page for watching a gufo
server and a vLLM server side by side: one Prometheus parser (class Prom) with
per-engine field maps, measured Δcounter/Δt rates for engines that export no
rate gauge, and strict read-only GET-only routing. Engines are opt-in via
*_BASE_URL — unset means no panel, no poll, and a 404 {"configured": false}
without dialling.
Includes the container image and CI so the dashboard can be deployed as an
image rather than a checkout:
- Containerfile: uv-locked two-stage build on python:3.14-slim, non-root
(uid 10001), binds 8090 (8000 is vLLM's port in this fleet), healthcheck on
/api/config so a dead engine never marks the dashboard unhealthy. No frontend
build stage — static/index.html is bundler-free by design and is copied as-is.
- .gitea/workflows/build-and-push.yml: publishes
gitea.reeseapps.com/Experimental/llm-monitor on main + release tags.
114 tests, no network and no real engines required.
LLM-Generated: true
50 lines
2.8 KiB
Plaintext
50 lines
2.8 KiB
Plaintext
# Captured verbatim from http://deskwork.reeselink.com:8731/metrics (gufo 0.16.0, Qwen3.8 Flash Next,
|
|
# --sessions 2, --speculative mtp). Re-capture after an engine upgrade; see tests/test_real_contracts.py.
|
|
# Values are point-in-time and drift between captures — assert on names/sources, not exact numbers.
|
|
|
|
# HELP gufo_device_lost_total Confirmed GPU context losses
|
|
# TYPE gufo_device_lost_total counter
|
|
gufo_device_lost_total 0
|
|
# HELP llamacpp:prompt_tokens_total Total prompt tokens processed, excluding cache hits
|
|
# TYPE llamacpp:prompt_tokens_total counter
|
|
llamacpp:prompt_tokens_total 374263
|
|
# HELP llamacpp:prompt_tokens_cached_total Total prompt tokens reused from cache
|
|
# TYPE llamacpp:prompt_tokens_cached_total counter
|
|
llamacpp:prompt_tokens_cached_total 29650554
|
|
# HELP llamacpp:prompt_seconds_total Prompt process time
|
|
# TYPE llamacpp:prompt_seconds_total counter
|
|
llamacpp:prompt_seconds_total 341.91072852000008
|
|
# HELP llamacpp:tokens_predicted_total Total tokens generated
|
|
# TYPE llamacpp:tokens_predicted_total counter
|
|
llamacpp:tokens_predicted_total 173091
|
|
# HELP llamacpp:tokens_predicted_seconds_total Predict process time
|
|
# TYPE llamacpp:tokens_predicted_seconds_total counter
|
|
llamacpp:tokens_predicted_seconds_total 5458.0845807790029
|
|
# HELP llamacpp:n_tokens_max Largest observed n_tokens.
|
|
# TYPE llamacpp:n_tokens_max counter
|
|
llamacpp:n_tokens_max 252622
|
|
# HELP llamacpp:spec_decode_num_drafts_total Total speculative verification rounds
|
|
# TYPE llamacpp:spec_decode_num_drafts_total counter
|
|
llamacpp:spec_decode_num_drafts_total 54515
|
|
# HELP llamacpp:spec_decode_num_draft_tokens_total Total draft tokens proposed
|
|
# TYPE llamacpp:spec_decode_num_draft_tokens_total counter
|
|
llamacpp:spec_decode_num_draft_tokens_total 158803
|
|
# HELP llamacpp:spec_decode_num_accepted_tokens_total Total draft tokens accepted
|
|
# TYPE llamacpp:spec_decode_num_accepted_tokens_total counter
|
|
llamacpp:spec_decode_num_accepted_tokens_total 117552
|
|
# HELP llamacpp:prompt_tokens_seconds Prompt processing speed in tokens per second
|
|
# TYPE llamacpp:prompt_tokens_seconds gauge
|
|
llamacpp:prompt_tokens_seconds 820.2841172907755
|
|
# HELP llamacpp:predicted_tokens_seconds Generation speed in tokens per second
|
|
# TYPE llamacpp:predicted_tokens_seconds gauge
|
|
llamacpp:predicted_tokens_seconds 43.015060732721352
|
|
# HELP llamacpp:requests_processing Number of admitted requests, including cache preparation
|
|
# TYPE llamacpp:requests_processing gauge
|
|
llamacpp:requests_processing 0
|
|
# HELP llamacpp:requests_deferred Number of requests waiting for a session
|
|
# TYPE llamacpp:requests_deferred gauge
|
|
llamacpp:requests_deferred 0
|
|
# HELP llamacpp:kv_cache_usage_ratio In-flight prompt and generated tokens over sessions times context; excludes retained cache
|
|
# TYPE llamacpp:kv_cache_usage_ratio gauge
|
|
llamacpp:kv_cache_usage_ratio 0
|