Files
brain-of-reese/tests/e2e/test_configurable_brand.py
T
ducoterra d22d260b8b
Build and Push Containers / build-and-push-app (push) Successful in 5m43s
Build and Push Containers / build-and-push-db (push) Successful in 12s
phase: 91_admin_theme_tab
All verification is complete — this pass needed no code changes. Final report:

**Phase 91 — Admin Theme tab: final verification pass (all 6 tasks already in `complete/`)**

- Verified pre-paint theming end-to-end: `ui_settings` store + resolver, admin `GET/PUT /api/ui-settings`, `CachingMiddleware` inline-`<style id="bor-theme">` injection before `</head>` (incl. `/shared/<token>` prefix branch, unit-pinned), CSP sha256 exemption for the inline tag, Theme tab shell + `theme.js` editor, CSS-file theming fully retired.
- No defects found; zero changes made — working tree left exactly as the task executors left it.
- Tests: `uv run pytest --cov=app` → 1841 passed, 0 failed (TOTAL coverage **99%**; theming/ui_settings/caching all 100%); `uv run pytest tests/e2e/test_admin_theme_tab.py -v --no-cov` → **5 passed** in isolation.
- Lint/types: `uv run ruff check .` → All checks passed; `uv run pyright` → 0 errors, 0 warnings.
- Criteria: (1) unset deployment byte-identical, no `#bor-theme` anywhere — ✓ (unit no-op test + E2E reset byte-compare); `rg "BOR_THEME|themes/"` → single hit is the permitted doc-history comment in `frontend/index.html`. (2) admin-only gate + 403s for anonymous and token users — ✓ (E2E test 3). (3) saved theme inline before `</head>` on every page incl. `/shared/<token>`, computed `--brand` on first paint for admin + anonymous — ✓ (E2E test 2 + unit). (4) reset → byte-identical; 5 contrast pairs warn <4.5:1, non-blocking — ✓ (E2E tests 4–5). (5) suite green, >90% coverage, lint clean — ✓. (6) commit deferred to harness per rules.
- Notable: `.agents/PLAN.md` is absent from the repo — the phase overview's Design section was used as the binding spec; no deviation resulted.
- Next pending phase: **none** — 91 is the last phase in `todo/`.
2026-09-09 17:22:24 -04:00

256 lines
10 KiB
Python

"""Phase 39 E2E (Playwright): the configurable app name (``BOR_APP_NAME``).
Story: ``.agents/user_stories/configurable-brand.md``
Run in isolation (DB must be up: ``podman compose up -d db``):
uv run pytest tests/e2e/test_configurable_brand.py -v --no-cov
Contract under test (owner ask — "a way to customize the name for
'Brain of'. Should be an env var"):
* one env var (``BOR_APP_NAME``, default "Brain of Reese") drives the
display name on EVERY page — the ``<title>``s, the header
``.brand-text`` brand, the empty-state greeting, the ``#messages``
aria-label, and the chat status labels — via the public
``GET /api/config`` + the classic ``assets/brand.js`` layer;
* a name starting ``"Brain of "`` keeps the bold split (``Brain of
<strong>rest</strong>``); the name is HTML-escaped (the story's
acceptance criteria, AC-2);
* with the variable UNSET the app is byte-identical to today — the
shared conftest server (the default name every other suite's
title/label assertions depend on) still renders "Brain of Reese".
Determinism note: this story needs a SECOND app instance — the shared
conftest server keeps the default name, so ``testy_server`` boots the
same env block (same DB, the mock-LLM base URL, the admin auth, the
static dir, the mock-calibrated threshold) with exactly two changes:
``BOR_APP_NAME="Brain of Testy"`` and port ``APP_PORT + 1``. Every
assertion is settled-state: Playwright's ``expect`` retries ride out
the brand.js ``/api/config`` fetch (the name is applied asynchronously
after the fetch answers). The one chat turn is pre-token-labeled — the
``think out loud`` marker makes the mock stream ~2.7k chars of
reasoning at 12 chars / 0.02 s (~4.6 s) before the first content frame,
so the "… is thinking" label is stable for the whole window regardless
of what the turn answers (grounded or deflected — no DB seeding
needed).
Test → story mapping (Playwright Mapping Rule):
1. ``test_api_config_serves_both_names``
2. ``test_index_carries_the_custom_brand``
3. ``test_other_pages_titles_carry_the_name``
4. ``test_chat_status_label_uses_custom_name_pre_token``
5. ``test_shared_server_keeps_the_default_name``
"""
from __future__ import annotations
import os
import subprocess
import sys
from collections.abc import Iterator
import httpx
import pytest
from playwright.sync_api import Page, expect
from e2e.auth_helpers import login
from e2e.conftest import (
ADMIN_PASSWORD,
APP_PORT,
REPO,
SESSION_SECRET,
USE_REAL_LLM,
_wait_http,
)
TESTY_PORT = APP_PORT + 1
TESTY_URL = f"http://127.0.0.1:{TESTY_PORT}"
TESTY_NAME = "Brain of Testy"
DEFAULT_NAME = "Brain of Reese"
def expect_inner_html(page: Page, selector: str, expected: str, timeout: int = 15_000) -> None:
"""Retrying innerHTML equality (Playwright's Python API ships no
``to_have_inner_html`` assertion). The brand layer applies the name
when its ``/api/config`` fetch answers, so the check must poll —
``wait_for_function`` does, on Playwright's own retry clock."""
page.wait_for_function(
"""([sel, expected]) => {
const el = document.querySelector(sel);
return el !== null && el.innerHTML === expected;
}""",
arg=[selector, expected],
timeout=timeout,
)
@pytest.fixture(scope="session")
def testy_server(mock_llm: int) -> Iterator[str]:
"""A SECOND app instance, booted with the overridden name.
The shared conftest ``app_server`` keeps the default name (every
other suite's title/label assertions depend on it) — so this
fixture copies its env block verbatim (same DB, the mock-LLM base
URL, ``BOR_ADMIN_PASSWORD``/``BOR_SESSION_SECRET``,
``BOR_STATIC_DIR``, ``BOR_RELEVANCE_THRESHOLD``) with exactly two
changes: ``BOR_APP_NAME="Brain of Testy"`` and a distinct port
(``APP_PORT + 1`` per the conftest convention). Started after
``mock_llm`` is available (its fixture dependency).
"""
env = dict(os.environ)
env.pop("DEBUGPY", None)
env["BOR_ENVIRONMENT"] = "e2e"
env["BOR_STATIC_DIR"] = str(REPO / "frontend")
env["BOR_LLM_BASE_URL"] = (
"https://aipi.reeseapps.com/v1"
if USE_REAL_LLM
else f"http://127.0.0.1:{mock_llm}/v1"
)
# The mock's token-overlap embeddings have their own score
# distribution — the same mock-calibrated threshold as the shared
# instance, so this suite's turn behaves like every other story's.
env["BOR_RELEVANCE_THRESHOLD"] = "0.30"
env.setdefault(
"BOR_DATABASE_URL",
"postgresql+psycopg://reese:reese@localhost:5432/brain_of_reese",
)
# Phase 16: admin auth must be set or create_app() refuses to boot.
env["BOR_ADMIN_PASSWORD"] = ADMIN_PASSWORD
env["BOR_SESSION_SECRET"] = SESSION_SECRET
# The phase-39 override — the whole story:
env["BOR_APP_NAME"] = TESTY_NAME
proc = subprocess.Popen(
[sys.executable, "-m", "uvicorn", "app.main:app",
"--host", "127.0.0.1", "--port", str(TESTY_PORT), "--log-level", "warning"],
cwd=REPO,
env=env,
)
try:
_wait_http(f"{TESTY_URL}/api/health")
yield TESTY_URL
finally:
proc.terminate()
try:
proc.wait(timeout=10)
except subprocess.TimeoutExpired:
proc.kill()
# ---------------------------------------------------------------------------
# 1. The endpoint the brand layer reads — overridden on the second
# instance, default on the shared one
# ---------------------------------------------------------------------------
def test_api_config_serves_both_names(testy_server: str, app_server: str) -> None:
r = httpx.get(f"{TESTY_URL}/api/config", timeout=5)
assert r.status_code == 200
body = r.json()
# Phase 59 (task 05): the third key is the docs-push flag — the
# "Save as doc" gating; both instances run with BOR_DOCS_REPO
# empty, so it is the inert false here. Phase 62 (task 01): the
# endpoint grew with the UI-customization keys; phase 91
# (task 03) deleted the retired CSS-file theming's ``theme`` key —
# the five keys below are the entire contract (this suite's
# instances carry no UI-customization overrides, so the string
# keys are their defaults).
assert set(body) == {
"app_name", "version", "docs_repo_configured",
"input_placeholder", "footer_text",
}
assert body["app_name"] == TESTY_NAME
assert body["docs_repo_configured"] is False
# The shared conftest instance keeps the default (the other
# suites' title/label contract rides on it) — and its key set
# tracks the endpoint contract (five keys after phase 91,
# task 03).
r2 = httpx.get(f"{app_server}/api/config", timeout=5)
assert r2.status_code == 200
r2_body = r2.json()
assert set(r2_body) == {
"app_name", "version", "docs_repo_configured",
"input_placeholder", "footer_text",
}
assert r2_body["app_name"] == DEFAULT_NAME
# ---------------------------------------------------------------------------
# 2. The chat page — title, header brand, greeting, stream aria-label
# ---------------------------------------------------------------------------
def test_index_carries_the_custom_brand(page: Page, testy_server: str) -> None:
page.goto(testy_server + "/")
# The brand layer applies the name when /api/config answers — the
# retrying expectations ride out that fetch.
expect(page).to_have_title(TESTY_NAME, timeout=15_000)
# The "Brain of …" name keeps the bold split (AC-2) — and the name
# arrives escaped (Testy has no special characters, but the markup
# shape is the contract).
expect_inner_html(page, ".brand-text", "Brain of <strong>Testy</strong>")
# The empty-state greeting (the TreeWalker prose pass).
expect(page.locator("#empty-state h1")).to_have_text(
f"Hey! I'm {TESTY_NAME}.", timeout=15_000
)
# The message stream's accessible label (the attribute pass).
expect(page.locator("#messages")).to_have_attribute(
"aria-label", f"Conversation with {TESTY_NAME}", timeout=15_000
)
# ---------------------------------------------------------------------------
# 3. The other pages — their <title>s carry the name too
# ---------------------------------------------------------------------------
def test_other_pages_titles_carry_the_name(page: Page, testy_server: str) -> None:
page.goto(testy_server + "/sources.html")
expect(page).to_have_title(f"Sources · {TESTY_NAME}", timeout=15_000)
page.goto(testy_server + "/login.html")
expect(page).to_have_title(f"Sign in · {TESTY_NAME}", timeout=15_000)
# ---------------------------------------------------------------------------
# 4. The chat status label — a pre-token turn on the custom instance
# ---------------------------------------------------------------------------
def test_chat_status_label_uses_custom_name_pre_token(
page: Page, testy_server: str, db_ready: None
) -> None:
login(page, testy_server, next="/")
expect(page.locator("#send-btn")).to_be_enabled(timeout=15_000)
# The ``think out loud`` marker (mock_llm.py) makes the answer
# stream ~2.7k chars of reasoning FIRST — the pre-token window.
# Works on the default (possibly empty) KB: a deflected answer is
# fine, the label assertion is pre-token, no seeding required.
page.fill("#message-input", "think out loud — what is the capital of France?")
page.click("#send-btn")
# The pre-token status label carries the configured name (the
# ~4.6 s reasoning stream keeps the state "thinking" — the label
# is stable for the whole window).
expect(page.locator("#send-status")).to_have_text(
f"{TESTY_NAME} is thinking", timeout=15_000
)
# The turn always finishes — the button is never left stale
# (PLAN §7.4), whatever the turn answered.
expect(page.locator("#send-label")).to_have_text("Send", timeout=60_000)
# ---------------------------------------------------------------------------
# 5. The no-op regression — the shared default-name instance is
# byte-identical to today
# ---------------------------------------------------------------------------
def test_shared_server_keeps_the_default_name(page: Page, app_server: str) -> None:
page.goto(app_server + "/")
expect(page).to_have_title(DEFAULT_NAME, timeout=15_000)
# With the variable unset the brand pass is a no-op: the header
# renders exactly the pre-phase-39 markup.
expect_inner_html(page, ".brand-text", "Brain of <strong>Reese</strong>")