brain-of-reese

Author	SHA1	Message	Date
ducoterra	1200437bf8	phase: 168_admin_settings_panel Build and Push Containers / build-and-push-app (push) Successful in 4m4s Details Build and Push Containers / build-and-push-db (push) Successful in 15s Details Phase 168 — Admin Settings panel — final verification: PASS 1. Implemented/verified: `/settings.html` (admin-only) with the 75-field catalogue (`app/core/settings_catalog.py`), DB-over-env overrides in Postgres (`app_settings`, migration 0028 at head, `settings_overlay.py` resolver, `app/api/admin_settings.py` — 4 admin-only routes), live-apply on save with no restart + restart-required badges, Reset/Clear all, write-only secrets, `.env`-never-written, `BOR_SETTINGS_DB=0` kill switch. 2. Phase E2E: 12/12 — run with `E2E_APP_PORT=8200` (ports 8123/8124 are held by an unrelated "undercooked" project; no process killed, no code change — the documented env override). 3. Regression set: all 7 suites green in isolation (theme tab, API tokens, configurable brand, global tuning, admin auth, cache busting, wide desktop column — 38 tests). 4. Full suite: unit+integration exit 0 (4066 passed), app/ coverage 99% (gate >90%); ruff clean, pyright 0 errors / 0 warnings. 5. Log contract (rule 10) verified live: per-turn + per-response byte-budget lines present; settings write lines carry key + action, never the value. 6. Byte-budget audit: all endpoints under the 262,144 B budget; settings catalogue 23,513 B (gzip 3,326). 7. Defect fixed (one): criterion 5 had no integration pin — added `test_bad_row_inserted_directly_never_bricks_boot` to `tests/integration/test_admin_settings_api.py` (malformed row inserted directly → fresh `create_app()` boots, row skipped with logged reason, rest of table applies, `/api/health` 200) — 12/12 green. 8. Docs pass: `README.md` and `AGENTS.md` reviewed in full — both consistent with the as-built feature (Settings page table, Settings section, Configuration-reference note, `.env.example` block); no changes required. 9. Cleanup: audit app killed (by PID); `app_settings` left empty (0 rows); all changes left in the working tree (no commit, per protocol). 10. Completion criteria: all 7 checkboxes verified green (criterion 7's commit is the harness's). 11. Next pending phase: `170_edit_bubble_sizing`.	2026-10-10 01:05:14 -04:00
ducoterra	2ac37455f0	phase: 167_api_payload_diet Build and Push Containers / build-and-push-app (push) Successful in 1m45s Details Build and Push Containers / build-and-push-db (push) Successful in 14s Details All gates green. Final report: Verified (phase 167 final pass — all 6 tasks already in `complete/`) - Live re-measure of the headline criterion on the 1,000-doc live-replica corpus (restored `data/bor_live_kb_replica.dump.sql` into a scratch DB `bor_audit`, alembic 0011→0027, dropped after; the shared dev DB was never touched): `GET /api/docs/tree` default depth=1 = 8,474 identity → 1,128 B with `Content-Encoding: gzip` (< 40 KB bar; ~2 MB defect fixed), repeat load 304 / 0 bytes; depth=8 265,147→23,515; node drill 20,844→1,065; `/api/docs` 246,366→45,104; `/api/documents/content` 892,124→60,776 (`LOOK`, accepted-with-why). Reproduces `AUDIT.md` to within 1 byte. - Transport contracts proven live: `POST /api/chat` no `Content-Encoding` + frames arriving live + budget line `… enc=identity duration_ms=7380 stream=1`; HTML still `no-cache` with the `?v=` rewrite (and gzipped); A20 headers on 200 and 304; ETag identical across identity/gzip; `depth=0\|9\|abc`→422; anonymous tree/node→403; unknown folder/source→404 `unknown node`. Gates (all 100% green) - `uv run pytest` → 3980 passed; `uv run pytest --cov=app --cov-report=term-missing` → TOTAL 99% (`compression.py`, `http_cache.py`, `response_budget.py` 100%; `api/docs.py` 99%, one defensive dedupe line). - `uv run ruff check .` → All checks passed; `uv run pyright` → 0 errors. - Phase + regression E2E in isolation (`--junitxml`, exit codes): `test_kb_tree_lazy_load` 11, `test_kb_tree` 8, `test_kb_tree_nav` 4, `test_navbar_refresh` 7, `test_document_dates` 6, `test_git_source_dates` 4, `test_sync_summary_visibility` 3, `test_table_ux_polish` 6, `test_sources_midstream_bug` 6, `test_ls_tree_drilldown` 3, `test_smoke` 3 — 0 failures/errors (the earlier `-q -q` run had simply suppressed pytest's summary line). Documentation — README.md + AGENTS.md reviewed in full (1,436 / 80 lines): - Fixed (pre-existing, phase-167-exposed): README Caching & deploys claimed "One Starlette middleware (`app/core/caching.py`) applies the rule" while the section now describes three transport layers → rewritten to name caching/compression/http_cache, the real outermost→innermost order, and why `bytes=` is uncompressed. - AGENTS.md rule 5 (UI Structure Check) gained the phase-167 clause: a lazily-drilled level keeps the current level rendered, its in-flight `role="status"` / `role="alert"`+Retry row lives in the same bounded scroll panel, and stat cards read server `totals` (never a walk of a depth-limited tree). - Cross-checked and consistent: every `BOR_` in `.env.example` is in the README table, every `Settings` field is documented, all 15 README-cited API routes exist in the app, no stale "one fetch / drill client-side" claim remains anywhere. Notable decisions / deviations* - `compression.py` adds a documented `_RebufferSmallResponses` seam beyond the D1 sketch (the caching layer's `BaseHTTPMiddleware` re-framing otherwise defeats Starlette's `minimum_size` exemption and inflates tiny responses) — integration-pinned, math still Starlette's. - A node-route 404 = vanished folder → honest reset to top level (per `00_phase.md` D4/D6), not task-06's "alert + Retry"; 500 shows alert+Retry with the level preserved — both pinned, nothing weakened. - Retrieval battery not measurable (shared E2E DB holds no corpus), but `git diff --name-only -- app/rag` is empty, so retrieval is unchanged by construction. `AUDIT.md` left byte-identical (it lives under `todo/`, off-limits to this pass); no git index/history commands run. Next pending phase: none — `167_api_payload_diet` is the only entry in `.agents/phases/todo/`; the harness moves it to `complete/` and commits.	2026-10-08 21:23:49 -04:00
ducoterra	34d60efbc1	phase: 164_chat_error_honesty Build and Push Containers / build-and-push-app (push) Successful in 2m11s Details Build and Push Containers / build-and-push-db (push) Successful in 29s Details All gates green. Report: - Verified (phase 164, all 4 tasks already in `complete/`): `HistoryTurn`/`ChatMessage`/`ChatThinkingSegment` caps → 600 000, `history`/saved-messages lists → 500, new `SavedChatCreate/Update` total-8 000 000-char validator; exported `errorDetailText` at the two previously unguarded chat paths (pre-stream `!res.ok` + SSE `error` frame); `FAILED_REQUEST_TEXT` + `bubbleText` threading + phase-114 banner hint; dedicated E2E `tests/e2e/test_chat_error_honesty.py`. - Final-pass additions: `tests/integration/test_chat_api.py::test_history_rejects_one_char_over_the_text_cap` (endpoint-level >600k → 422 with the pydantic list-of-objects `msg` — the criterion's upper half was only unit-pinned); README env rows for `BOR_APP_VERSION` + `BOR_SESSION_COOKIE`; restored `test_document_viewer.py`'s tracked screenshot artifact dirtied by the E2E run (via read-only `git show`, no index/history touched). - Tests/lint (exact commands): `uv run pytest --cov=app --cov-report=term-missing` → 3837 passed, `app/` coverage 99% (>90%); `uv run pytest tests/e2e/test_chat_error_honesty.py -v --no-cov` → 4 passed in isolation; per-file loop over all 148 E2E files (`uv run pytest tests/e2e/<f> -q --no-cov`) → 148 × exit 0, incl. `test_failed_turn_retry`, `test_chat_save_payload_limits`, `test_edit_and_resend`, `test_llm_history`, `test_smoke`; `uv run ruff check .` → All checks passed; `uv run pyright` → 0 errors. - Completion criteria: pre-stream 422 shows the distinct line + verbatim `msg`, `[object Object]` unrepresentable + no `input` in DOM — met (unit totality/source pins + E2E asserts 1–2); 525k history accepted (200 settles) / >600k → 422 / saved chat 201 + 8M bound — met; transport + SSE-frame settles keep `FAILED_TURN_TEXT`, stop/abort untouched, §7.4 re-enables — met; budget trim, `message` 4000, the 7 guarded detail-readers and all SSE shapes byte-identical (diff touches only caps + the two chat paths) — met; README/AGENTS full review + proxy deploy note — met; commit/`complete/` move = pipeline gate. - Docs: README reviewed in full (env tables cross-checked programmatically: 74 `BOR_` rows vs `Settings` defaults — no mismatches; every `.env.example` var documented; referenced scripts/pages/endpoints/`query_log` columns exist) — found & fixed the 2 undocumented real knobs above; the phase's payload-limits section, failed-turn copy and `client_max_body_size ≥ 16 MB` deploy note verified accurate. `AGENTS.md` verified consistent (rules, gitignore list, quick-reference commands, referenced paths all correct) — no changes needed. - Deviations: `ChatThinkingSegment.text` raised 32 000 → 600 000 too (not itemized in A1, but its own docstring mirrors `HistoryTurn.thinking`; without it a long-thinking turn 422s its own auto-save — same mirror invariant). No live-infra changes made (the proxy limit lives in the separate deployment repo; README note only). - Next pending phase*: none — `164_chat_error_honesty` was the only entry in `todo/`.	2026-10-07 18:00:12 -04:00
ducoterra	6ba46e735a	phase: 163_pdf_strip_additive_selfheal Build and Push Containers / build-and-push-app (push) Successful in 2m3s Details Build and Push Containers / build-and-push-db (push) Successful in 21s Details All gates verified. Final report: Phase 163 — final verification pass (all 5 tasks already complete; verification-only run) - Verified D1–D4 in code: `page_strip_mode` column + migration 0027, `DocContent` absent-never-null rule keyed off `page_count`; `_persist_pdf_pages` render → atomic tmp+`os.replace` writes → stale-tail-last + `strip_class` stamp; `_regate_pdf_strip` on both unchanged paths (mirror gate, heal, repair, fail-soft, one INFO line only when acting); viewer mode branch + Text/Pages toggle (Text default, `aria-pressed`, no innerHTML, lazy imgs). - `uv run pytest --cov=app --cov-report=term-missing` → 3796 tests, exit 0, coverage 99% (>90%) - `uv run pytest tests/e2e/test_pdf_strip_additive_selfheal.py -v --no-cov` → 5 passed in isolation - `test_pdf_pages_in_sources + test_pictorial_pdf + test_garbage_pdf` → 10 passed; `test_document_viewer(_context) + test_image_documents` → 20 passed - `uv run ruff check .` clean; `uv run pyright` → 0 errors; alembic 0027 downgrade→upgrade CLI round-trip clean (+ integration pins) - Completion criteria: additive view w/ toggle ✅ · primary DOM byte-identity ✅ · write-first order/mid-write-failure/atomic pins ✅ · heal + repair E2E ✅ · zero vision/LLM on fast path (mock-captured) ✅ · non-qualifying payload byte-identity ✅ · docs pass ✅ - Documentation: README.md + AGENTS.md reviewed in full — the phase's updates are accurate; all config-table defaults cross-checked against `app/config.py` (no drift), every page route, script, and E2E command referenced exists, every `.env.example` var documented — verified consistent, no changes needed. - Notable: live `Letumdei` repair is owner-runtime post-deploy per D5 (next production Sync self-heals; no live changes made); the modified `.agents/screenshots/doc_modal_scrollbar_1280.png` is an E2E-regenerated artifact left for the pipeline commit. - Next pending phase: `164_chat_error_honesty`	2026-10-07 13:57:30 -04:00
ducoterra	8172956c15	phase: 160_tool_budget_telemetry Build and Push Containers / build-and-push-app (push) Successful in 2m27s Details Build and Push Containers / build-and-push-db (push) Failing after 2m8s Details All green. Final report: Phase 160 completion pass — verified (final verification; all 5 tasks already in `complete/`) - Verified, no code defects found: budget trailers (`TOOL_BUDGET_REMAINING/LAST/SPENT`), cap-path rejection + `ROUND_CAP_FALLBACK_ANSWER` + `ROUND_CAP_WRAPUP_INSTRUCTION`, `done.budget_exhausted` (ABSENT-when-false), `rounds=/cap_hit=` log fields, `agent_max_rounds=10` default, frontend Continue button + restore + shared-page exclusion, mock markers. - Tests/lint: `uv run pytest` 153/153 green (EXIT 0); `uv run pytest --cov=app --cov-report=term-missing` TOTAL 99% (>90%); `uv run ruff check .` clean; `uv run pyright` 0 errors/0 warnings. - Criteria: ① decreasing trailer pinned by unit tests (9→…→spent) ✅ ② cap path ends readable, no tool lines after cap (E2E) ✅ ③ `budget_exhausted` true-only-on-cap, absent otherwise (integration) ✅ ④ Continue button → one fresh `continue` turn, fresh budget, record intact (E2E) ✅ ⑤ flag survives refresh; shared chat never renders it (`shared.js` has no `budget_exhausted` path) ✅ ⑥ `max_rounds=0` byte-identical single `tools=None` request; default still 10 ✅ ⑦ full suite/coverage/lint green ✅ ⑧ `test_tool_budget_telemetry.py` 7/7 in isolation; all 6 regression E2E suites green in isolation ✅ ⑨ commit + phase move = harness (I make no git history/index changes). - Docs: README.md — fixed: the "Continue researching" button and cap behavior were undocumented (added a Chat-section paragraph + an Agent-tools-section paragraph, incl. the phase-71 recorded-revision note); env-var table, commands, and architecture all verified consistent otherwise. AGENTS.md — verified consistent, no changes needed. - Decisions: no code changes required — phase was fully implemented; only README docs added. No live-infrastructure touched. - Next pending phase: `161_reasoning_bubble`.	2026-10-06 01:42:44 -04:00
ducoterra	31bd903a93	phase: 158_thinking_timeline Build and Push Containers / build-and-push-app (push) Successful in 8m38s Details Build and Push Containers / build-and-push-db (push) Successful in 32s Details All verification complete. Every gate is green and the docs check out. Final report: ## Phase 158 final verification pass — COMPLETE Verified (all tasks pre-completed; this pass re-ran the full gate): - Unit + integration: `uv run pytest --cov=app --cov-report=term-missing` → 3618 passed, 99% coverage on `app/` (>90% gate) - Phase E2E in isolation: `uv run pytest tests/e2e/test_thinking_timeline.py -v --no-cov` → 6/6 passed (order pin, fold-at-rest, live-open, restore+`segments` array, shared page, no-thinking single disclosure) - Regression E2E, each in isolation: `test_thinking_display` 5✓, `test_tool_call_compact` 4✓, `test_turn_progress_loader` 3✓ (per-run pin updated), `test_big_read_progress` 4✓, `test_agent_document_tools` 4✓, `test_share_chat` 4✓, `test_chat_persistence` 4✓, `test_smoke` 3✓ - Lint/types: `uv run ruff check . && uv run pyright` → clean (0 errors) Completion criteria: all 9 met — timeline E2E pins ✓, restore/shared `segments` ✓, no-thinking single-disclosure + the three UNCHANGED regression suites green ✓, pre-phase byte-identical round-trip (integration pin: key absent, never null; >50 / >32 000 / empty text / unknown kind all 422) ✓, full suite + coverage + E2E + lint ✓, `git diff --stat` footprint limited to `app/schemas.py`, `frontend/assets/{app,shared}.js`, `tests/`, README, phase files (a pre-existing owner `TODO.md` edit is out of scope, not staged by the phase commit) ✓, D15→per-run supersession recorded in the updated pin ✓. (Commit + phase move are the harness's job; task dirs already in `complete/`.) Documentation: README.md — Thinking section correctly describes the phase-158 timeline; config reference matches `.env.example` exactly; page table matches registered routes; no stale single-block wording. AGENTS.md — rules and quick-reference commands all accurate. Verified consistent — no changes needed. Decisions/deviations: none. `test_tool_call_compact.py` carries a one-line docstring-only update (referenced the removed `closeToolCalls`); its test logic is byte-identical to the phase-117 contract and green. Next pending phase: none — `todo/` contains only 158.	2026-10-05 02:52:55 -04:00
ducoterra	b233c8d714	phase: 148_pdf_pages_in_sources Build and Push Containers / build-and-push-app (push) Successful in 2m28s Details Build and Push Containers / build-and-push-db (push) Successful in 16s Details Phase 148 — final verification pass: complete, 100% green. - Verified (tasks 01–04 already implemented): page render/persist at index (`_persist_page_copies`, fail-soft, stale-replace, qualifier-loss, prune hook via `_delete_page_copies`); public `GET /api/documents/{id}/pages/{n}` (uuid4-credential, 404-all-non-servable, `image/png` + cache header); `DocContent.page_urls` additive-omitted; shared `renderDocument` strip (lazy imgs, "Page N" captions, text + Summary suppressed, onerror note, createElement-only); migration 0026; `pdf_page_dir` setting; `.env.example` entry - Completion criteria: (1) pictorial + fallback classes get `p{N}.png` + `page_count`, text-heavy gets neither — pinned, pass; (2) unchanged re-sync renders zero (fast path) — pass; (3) changed re-index replaces copies, qualifier-loss/prune delete — pass; (4) route 404 matrix + payload key absent-never-null — pass; (5) modal AND /document.html strip with suppression, text-heavy byte-identical — E2E pass; (6) see below; (7) no completed-phase drift — full suite green - Tests: `uv run pytest --cov=app --cov-report=term-missing` → 3461 passed, 0 failed, `app/` coverage 99% (>90%); `uv run pytest tests/e2e/test_pdf_pages_in_sources.py -v --no-cov` → 4 passed in isolation; `uv run ruff check .` clean; `uv run pyright` → 0 errors, 0 warnings - Documentation: README had 1 pre-existing inconsistency — the Production Deployment section's standalone `podman run` example (and compose note) omitted the required `BOR_ADMIN_PASSWORD`/`BOR_SESSION_SECRET` (the fail-loud boot gate the README's own Admin section documents — the container would refuse to start); fixed with the two `-e` flags + a note for the compose path. All else verified consistent: 70/70 `.env.example` vars documented, all defaults match `config.py`, pages table matches routes, Containerfile/esbuild/uid-10001/healthcheck/entrypoint claims accurate, QA commands match pytest config. AGENTS.md: verified consistent — no changes needed - Notable: repo uses `Containerfile` (Podman) — README's `podman build` example is valid as-is; no live infrastructure touched - Next pending phase: `149_sync_progress_box`	2026-10-01 16:58:01 -04:00
ducoterra	ab3f5f685b	phase: 146_search_tool_scope Build and Push Containers / build-and-push-app (push) Successful in 2m24s Details Build and Push Containers / build-and-push-db (push) Successful in 13s Details Phase 146 final verification pass complete — all green, tree untouched by me. Verified (final pass — both tasks already in `complete/`): - Scoped grep streams `{"type":"tool","name":"grep","argument":<pattern>,"path":<source/path>}`; bare grep/read/ls frames dump byte-identical (unit matrix in `test_sse_events.py` + builder pins in `test_chat_gate.py` L1364–1448) - Tool line `🔎 Searching for <pattern> in <source/path>` (two `<code>` spans, `.grep-scope` sibling, no new emoji); bare line byte-identical (unit Node test + E2E) - Status label "… is searching for X in Y" scoped-only; `path` persisted additively on the saved tool record and re-rendered on `/?chat=<id>` restore; pre-phase records restore byte-identically (E2E tests 2 & 3) Results (exact commands): - `uv run pytest --cov=app --cov-report=term-missing` → 3419 passed, `app/` coverage 99% (>90% ✓) - `uv run pytest tests/e2e/test_search_tool_scope.py -v --no-cov` → 3 passed in isolation ✓ - `uv run ruff check . && uv run pyright` → clean (0 errors) ✓ Completion criteria: all 6 ✓ (wire shape, UI line, status label, save/restore, gates, no completed-phase behavior change — full suite green includes all prior-phase pins). Documentation: README.md (incl. its phase-146 section) and AGENTS.md reviewed in full against the codebase — verified consistent, no changes needed (`.env.example` ⊆ README config tables; no stale vars; phase-100 72rem rule in AGENTS.md §5 matches shipped CSS; no-CDN/smoke-DB/gpgsign claims all confirmed). Notable: none — no defects found, no live-infrastructure touched, nothing committed per harness protocol. Next pending phase: `147_sync_changed_only`.	2026-10-01 12:48:04 -04:00
ducoterra	32a3ec4f5e	phase: 145_git_source_links Build and Push Containers / build-and-push-app (push) Successful in 2m23s Details Build and Push Containers / build-and-push-db (push) Successful in 13s Details Phase 145 final verification pass — all green, no code changes needed - Verified (no defects found): resolver `origin_for_source` + `_url_basename` (scp/`.git`/trailing-slash, sanitize, ambiguity WARNING); `origin:`/`branch:` lines in all four read shapes via shared `_origin_lines`; HIGH `<tools>` origin rule (verbatim + only-byte-change pins); `DocContent.origin_url/origin_branch` (absent-never-null serializer); `renderDocument` "Original" anchor (copyable verbatim URL, `_blank`/`noopener`, branch in title); mock scripted origin-link flow (disjoint trigger — grep-verified vs all other E2E files) - Tests: `uv run pytest --cov=app --cov-report=term-missing` → 3402 passed, `app/` coverage 99% (>90% gate); `uv run pytest tests/e2e/test_git_source_links.py -v --no-cov` → 4 passed in isolation; `uv run ruff check .` → clean; `uv run pyright` → 0 errors, 0 warnings - Completion criteria: (1) git read results carry origin/branch, local byte-identical — ✅ (unit pins + E2E control); (2) HIGH `<tools>` rule pinned, LOW byte-identical — ✅; (3) modal AND /document.html show Original link, branch in label when pinned, nothing for local — ✅; (4) full suite green + coverage + E2E + lint/types — ✅; (5) no completed-phase behavior change (read header line 1, mock prefix, done frame/SourceRef untouched, LOW sha) — ✅ - Extra regression check: re-ran shared-mock E2E suites `test_read_line_ranges.py` (2 passed) and `test_document_viewer.py` (8 passed) — no cross-suite regressions from the `mock_llm.py` addition - Documentation: README.md reviewed in full (env table ⊇ `.env.example`, pages/routes, config defaults, scripts, 17-color palette, 300 s guard, 2 s sync poll, phase-145 provenance section matches implementation) and AGENTS.md (72rem container, no-CDN test, smoke test, gitignore, gates) — verified consistent, no changes needed - Notable: phase-116 screenshot PNG was regenerated during this phase's E2E runs (byte re-encode only, visually identical, correct no-anchor local-source meta row) — left in tree for the harness commit - Next pending phase: `146_search_tool_scope` (then 147, 148, 149)	2026-10-01 11:13:43 -04:00
ducoterra	9e7262a5c8	phase: 139_read_range_tool_lines Build and Push Containers / build-and-push-app (push) Successful in 2m54s Details Build and Push Containers / build-and-push-db (push) Successful in 17s Details All verification is complete and green. Phase 139's three tasks (01–03) were already implemented in prior passes; this was the final verification pass, and every gate holds. ## Phase 139 — final verification report Verified in working tree (no code changes needed): - `readRangeSuffix` single-source-of-truth helper in `app.js` + byte-identical parity copy in `shared.js` (EN-dash ` (lines N–M)`, `(from line N)`, `(first N lines)`, `Number.isInteger(x) && x >= 1` guard mirroring the server's `_whole_line_number`) - `appendToolLine(wrap, name, argument, offset = null, limit = null)` — `<span class="read-range">` sibling after `<code>`, only when suffix non-empty; `shared.js` `addToolLines` parity - Live `tool` branch: guarded `ev.offset`/`ev.limit`, additive `toolAcc` records (non-range keeps pre-phase shape), status label carries the suffix (A2); restore path passes stored `t.offset`/`t.limit` through, phase-95 truncation note untouched - E2E: `SAME_FILE_TRIGGER` mock flow (same file read twice, offsets 10/20 then 40/15) + 3-test Playwright suite Test / lint / coverage results: - `uv run pytest` (unit + integration): 3283 passed, 9 skipped, 0 failed - `uv run pytest --cov=app --cov-report=term-missing`: TOTAL 99% (>90% gate) - `uv run pytest tests/e2e/test_read_range_tool_lines.py -v --no-cov`: 3 passed in isolation - `uv run ruff check .`: clean; `uv run pyright`: 0 errors, 0 warnings Completion criteria: 1. Range read renders `(lines N–M)` live; two same-file reads show DIFFERENT ranges — ✅ (E2E test 1) 2. Plain read byte-identical; phase-87/117 pins + emoji guard pass unedited — ✅ (E2E test 2 + full suite) 3. Suffix survives save → restore on chat page + shared page — ✅ (E2E test 3) 4. Full suite green, coverage >90%, E2E isolated green, ruff + pyright clean — ✅ 5. Commit + phase move — left to the harness per executor rules (no `git add`/`commit` run) Notable: the missing pytest summary line on one run was a transient output-buffering artifact, confirmed by re-run; DB was already up and healthy. Next pending phase: `140_pictorial_pdf_pages`	2026-09-30 12:55:23 -04:00
ducoterra	d3f8c7f2c8	phase: 135_git_source_branch Build and Push Containers / build-and-push-app (push) Successful in 2m34s Details Build and Push Containers / build-and-push-db (push) Successful in 14s Details All verification complete. No edits were needed by this pass — the phase work and docs were already consistent and green. Phase 135 final verification pass — report - Verified all 5 tasks' work present & correct: migration 0024 (reversible), `GitSource.branch` + 4 schema shapes, `validate_branch_name` (full check order per design), `clone_or_pull(…, branch)` (HEAD guard first, `--branch` clone, fetch+ff merge), both call sites pass `row.branch`, UI (add-form field, editor field, row tag), `file://` URL transport. - Completion criteria: (1) branch-mirrored through Sync + CLI — pass (E2E + integration); (2) `branch=None` byte-identical — pass (`test_branch_none_argv_is_byte_identical_pre_phase_sequence` green); (3) fixed 422s / local-row 422 / tri-state — pass; (4) mismatch fails loudly with remove-and-re-add — pass (E2E); (5) coverage 99% >90%, E2E isolated green — pass; (6) no regressions — pass. - Tests: `uv run pytest --cov=app --cov-report=term-missing` → 3223 passed, app/ 99%; `uv run pytest tests/e2e/test_git_source_branch.py -v --no-cov` → 4 passed (16.4 s); `uv run ruff check .` clean; `uv run pyright` → 0 errors, 0 warnings. - Documentation: README.md reviewed in full — phase-135 branch section accurate; the phase's README diff also correctly fixed a pre-existing stale line (shallow `--depth 1` clone vs full-history, phase 107). Routes, env defaults, feature lists verified against code. AGENTS.md — all 10 rules + quick-reference verified (referenced tests, PLAN.md, phases dirs, commands all accurate). Verified consistent — no changes needed. - No live-infrastructure changes (dev DB already running and healthy; no live steps in this phase). - Next pending phase: `.agents/phases/todo/136_force_push_reset`.	2026-09-28 21:15:03 -04:00
ducoterra	101156bada	phase: 131_read_line_ranges Build and Push Containers / build-and-push-app (push) Successful in 2m30s Details Build and Push Containers / build-and-push-db (push) Successful in 11s Details All 44 progress lines are pure dots, final line at 100%, exit 0. Everything is verified. Final report: Phase 131 — final verification pass (all 4 tasks already complete in working tree) - Verified implemented: `read(offset, limit)` schema + teaching descriptions; rewritten truncation notice; full 6-row dedupe matrix + range validation + `lines: a-b of N` header + slice cap in `_execute_tool`; wire-level `offset`/`limit` on `ChatToolEvent` (absent keys dropped → non-range frames byte-identical); mock-LLM `read the lines` flow; handbook repro (wording + line numbers derived from the real PDF at test time) - Tests: `uv run pytest --no-cov` → 3097 passed, exit 0; `uv run pytest --cov=app` → 99% on app/ (>90%); `uv run pytest tests/e2e/test_read_line_ranges.py -v --no-cov` → 2/2 in isolation (47.6 s); `tests/integration/test_read_line_ranges_handbook.py` → 2/2 (3.5 s); 10-file targeted E2E batch pinning pre-phase surfaces (grep/ls/plain-read/ALREADY_IN_CONTEXT/truncation) → 31/31; `ruff check .` clean; `pyright` 0 errors - Completion criteria: all 5 green — (1) exact range lines + `lines:` header, plain reads byte-identical (existing pins pass unchanged) ✅ (2) truncated-then-range succeeds end-to-end on the real handbook; other re-reads get teaching refusals ✅ (3) find-traps answered from real PDF text, no hardcoded wording ✅ (4) coverage + isolated E2E ✅ (5) no behavior change in completed phases ✅ - Docs: README + AGENTS reviewed in full. Fixed 3 inconsistencies: README missing `BOR_HISTORY_MAX_TURNS`/`BOR_HISTORY_MAX_CHARS` rows (pre-existing phase-74 gap — env-tunable, unit-pinned, undocumented); `.env.example` missing the same two vars (added); `.env.example` stale `BOR_READ_MAX_CHARS` comment (still said "grep-pointer notice (phase 95)" — updated to the phase-131 workflow notice). AGENTS.md verified consistent — no changes needed. All 67 `.env.example` vars documented, all defaults match `app/config.py`, pages/auth tables match live routes - Note: PLAN.md §7.1 still states the retired 46rem chat column (superseded by phase 100, which AGENTS.md rule 5 records correctly) — PLAN.md is off-limits for this pass, flagged only - Next pending phase: `132_image_upload_feedback`	2026-09-28 11:49:55 -04:00
ducoterra	62e4f6b572	phase: 124_image_chips_and_answers Build and Push Containers / build-and-push-app (push) Successful in 2m12s Details Build and Push Containers / build-and-push-db (push) Failing after 1m39s Details All green. Final report: Phase 124 final verification pass — all criteria verified, no defects found (nothing to fix) - Verified the implemented phase (all 7 tasks done, changes in working tree): `BOR_ANSWER_IMAGES` toggle, `show_image` tool + refusals + `holder.shown_images`, toggle-gated prompt clause, `answer_image` frame field (None-omitting serializer) + `ChatMessage` persistence, `merge_cited_docs` auto-cite bug fix, answer-figure UI (live/restore/shared/CSS), mock triggers + E2E suite. Also confirmed the bytes route → public change matches the phase-123 shared-chat precedent (task 06 design). - `uv run pytest --cov=app --cov-report=term-missing` → 2848 passed, TOTAL 99% (>90% gate) - `bash .agents/validate.sh` → validation OK (tests + coverage + ruff + pyright) - `uv run ruff check . && uv run pyright` → clean, 0 errors - `uv run pytest tests/e2e/test_answer_images.py -v --no-cov` (isolated) → 5/5 passed - Mock-inert spot checks: `tests/e2e/test_image_documents.py` 4/4, `tests/e2e/test_agent_document_tools.py` 4/4 Completion criteria: ① zero-read suggested-tier image doc chips with figure — verified (unit matrix, integration `test_zero_read_grounded_turn_auto_cites_suggested_image_doc`, E2E bug-fix flows); ② show_image → answer figure below text/above chips, second call refused, persists + restore + shared — verified (unit handler matrix, integration round-trip, E2E feature flow); ③ default-off byte-identical (3 tools, no clause, no key) — verified (unit + integration + E2E toggle-off); ④ full suite green / >90% / lint clean — verified above; ⑤ commit + phase move — harness responsibility (changes left uncommitted in working tree, no live-infrastructure changes made). Next pending phase: none — `todo/` holds only this phase; the pipeline is clear once the harness moves it.	2026-09-26 17:06:09 -04:00
ducoterra	bef24e05e2	phase: 123_chat_image_questions Build and Push Containers / build-and-push-app (push) Successful in 1m54s Details Build and Push Containers / build-and-push-db (push) Failing after 1m50s Details All gates green. Verification complete. Phase 123 — final verification pass (all 4 tasks already in `complete/`) - Verified the full implementation is in the working tree: `app/api/chat_images.py` (upload/serve pair), `ChatRequest.image`/`ChatMessage.image` (path-validated, omitted-when-None), toggle-off + stale-file hinted error frames, `build_user_content` multimodal build at both sites (chat.py deflected branch + `run_agent`), config-gated composer attach/preview/upload-then-send, restore + shared rendering, CSP `img-src 'self' data:` carve-out, mock-LLM capture buffer. - `uv run pytest` → 2796 passed, exit 0 (unit + integration). - `uv run pytest --cov=app --cov-report=term-missing` → TOTAL 99% (29/4615 missed; phase-123 modules 99–100%). - `uv run pytest tests/e2e/test_chat_image_questions.py -v --no-cov` → 5 passed in isolation. - `uv run ruff check . && uv run pyright` → clean (0 errors). Completion criteria: (1) attach→send→multimodal text+image to the model, bubble/reload/shared all render it, saved chat stores the PATH with `"base64" not in json.dumps(stored)` — verified (E2E tests 1–4 + integration round-trip); (2) `BOR_IMAGES=false` — control hidden, exact hinted error frame, zero model calls / no query_log row — verified (E2E test 5 + integration); (3) text-only byte-identical (`content` stays a plain `str`) — verified (unit + integration); (4) all gates green — verified; (5) commit + phase move — left to the harness per pipeline rules (no `git add`/`commit` run). No defects found; no live-infrastructure changes (repo + local dev DB only). Next pending phase: none — 123 is the last phase in `todo/`.	2026-09-25 05:19:18 -04:00
ducoterra	a19d78d284	phase: 122_image_documents Build and Push Containers / build-and-push-app (push) Successful in 1m57s Details Build and Push Containers / build-and-push-db (push) Failing after 13s Details Phase 122 (image documents) — final verification pass: all green. No code changes were needed; defects found: none. Verified (implementation already complete in working tree, reviewed end-to-end): - Toggle (`BOR_IMAGES`/`BOR_IMAGE_EXTENSIONS`/`BOR_IMAGE_DIR`, off by default) + `GET /api/config` `images` flag - Ingest: bytes digest, `image_dir` persistent copy, `content = summary = vision description` (chat-model call; only text embedded), fail-soft skip + `images_failed` counter - Serve/display: `/api/documents/{id}/image` route (404 matrix), viewer `<img>` + description, Sources 48px lazy thumbnails, chat inline source figure (alt = summary), agent `read` marker - Prune guard: images-off syncs never prune `is_image` docs Test / lint / coverage (exact commands & outcomes): - `uv run pytest` → exit 0 (green; note: pytest 9.1.1 `-q` omits the final count line in output — exit code authoritative) - `uv run pytest --cov=app --cov-report=term-missing` → 2715 passed, exit 0, TOTAL 99% (>90% gate) - `uv run ruff check . && uv run pyright` → "All checks passed!" / "0 errors, 0 warnings, 0 informations" - `uv run pytest tests/e2e/test_image_documents.py -v --no-cov` → 4 passed, exit 0 (isolation) Completion criteria: (1) images=true → described/embedded/displayed docs: ✅ (E2E + integration) · (2) images=false byte-identical + image docs survive sync: ✅ (E2E negative app + unit/integration) · (3) viewer + chat rendering with alt text; failed description skips + logs, sync completes: ✅ · (4) test/lint/coverage gates: ✅ · (5) commit + phase move: deferred to harness per this pass's rules (working tree left uncommitted). Notable deviation (pre-existing, documented in code): image route uses `require_user` (phase-79 posture, same gate as the document content endpoint) rather than the phase text's "public" parenthetical — matches the endpoint it mirrors. Next pending phase: `123_chat_image_questions`.	2026-09-25 01:54:23 -04:00
ducoterra	0f77e9a876	phase: 121_git_source_tokens Build and Push Containers / build-and-push-app (push) Successful in 2m3s Details Build and Push Containers / build-and-push-db (push) Failing after 14s Details Phase 121 final verification pass — all green (all 4 tasks already in `complete/`; verified, no defects found, no changes needed) - Verified implementation vs phase design: migration `0021` (reversible, round-tripped via `alembic downgrade base` + `upgrade head` → head `0021`), `GitSource.token` column, `normalize_credential`/`clone_url_for`/`sanitize_url`, clone callers switched (`sync.py`, `import_docs.py`), masked token fields in add form + editor, `extra="forbid"` output shapes - Tests: `uv run pytest` → 2662 passed, 0 failed (exit 0); `uv run pytest --cov=app --cov-report=term-missing` → TOTAL 99% (≥90% gate) - Lint/types: `uv run ruff check .` → All checks passed; `uv run pyright` → 0 errors, 0 warnings - E2E in isolation: `uv run pytest tests/e2e/test_git_source_tokens.py -v --no-cov` → 4 passed Completion criteria: 1. Private repo (UI add or pasted embedded-token URL) clones with injected token; token absent from every API response, page text, title attr, and full HTML — PASS (integration raw-JSON assertions + E2E `_assert_token_nowhere`) 2. Legacy embedded-token rows still clone from stored URL; output sanitized — PASS (`test_sync_legacy_row_clones_with_original_stored_url`, `test_get_masks_legacy_embedded_token_row`, env-fallback masking) 3. Public/local sources byte-identical — PASS (verbatim-URL + no-userinfo-unchanged tests) 4. pytest / coverage / ruff / pyright — PASS (see above) 5. Commit + phase move — harness responsibility; task files already in `complete/`, changes left in working tree (no commit made, per protocol) Notable: no deviations; DB left at head, functional. Next pending phase: 122_image_documents (then 123_chat_image_questions).	2026-09-24 20:51:39 -04:00
ducoterra	3a0fc3db05	phase: 120_failed_turn_retry Build and Push Containers / build-and-push-app (push) Successful in 3m5s Details Build and Push Containers / build-and-push-db (push) Failing after 2m13s Details All verification complete. Final report: Phase 120 — Failed-turn retry: verification pass (all 3 tasks were done; final verification + 1 regression fix) Verified: `ChatMessage.failed`/`error` (≤500, `extra="forbid"` intact); `finalizeFailedTurn` funnel on the 3 failure paths (catch-else, stream-drop guard, zero-frame fallback) with `failed: true` + capped detail + `markLastRetryable`; `appendFailedNote` restore branch (Save-as-doc/Tune excluded); `showErrorBanner`/`retryLastTurn` byte-pinned untouched; only the three paths persist `failed: true` (grep + unit pin); no test asserts the old broken behavior. Defect found & fixed (rule 7): a real navigate-away mid-turn let the browser's teardown fetch rejection (TypeError, not AbortError) leak into the failed funnel, persisting a phantom failed brain record — `test_sources_midstream_bug.py::test_no_orphan_brain_message_when_navigated_before_first_token` failed (2 `.msg` after reload) and violated the phase-20 navigate-away convention. Fixed: turn-scoped `leftThePage` flag (set unconditionally on `pagehide`, reset in `runTurn`) skips the funnel in the catch-else branch; pinned by new unit test `test_navigate_away_is_not_a_failed_turn`. No phase-overview/PLAN/todo/complete files touched; no commits made. Gates (exact): - `uv run pytest` → 2577 passed - `uv run pytest --cov=app --cov-report=term-missing` → TOTAL 4271 stmts, 99% (>90%) - `uv run pytest tests/e2e/test_failed_turn_retry.py -v --no-cov` → 4 passed (isolated) - `uv run ruff check . && uv run pyright` → clean (0 errors) - Regression E2E, isolated: `test_sources_midstream_bug.py` 6/6 (was 5/6); `test_llm_retry`/`test_tool_scaffolding_guardrails`/`test_stop_generation`/`test_navbar_refresh` 17/17 Completion criteria: (1) network error → banner + in-bubble Retry, re-ask without re-typing ✅ (E2E A); (2) refresh restores failed bubble + working Retry, no "new chat" ✅ (E2E C); (3) stopped/successful turns byte-identical ✅ (negative E2E, stop suite, byte-identity units); (4) pytest/coverage/lint/types ✅; (5) commit + phase move — left to the harness per pass rules. Notable: deviation = the regression fix above (a navigation is not a failed turn; phase-20 partial-persist convention restored). Next pending phase: `121_git_source_tokens`.	2026-09-24 18:50:36 -04:00
ducoterra	9820c361b0	phase: 118_summary_seed_context Build and Push Containers / build-and-push-app (push) Successful in 2m2s Details Build and Push Containers / build-and-push-db (push) Successful in 14s Details Phase 118 final verification pass — complete. All criteria verified; 4 pre-existing defects found and fixed. - Verified: summary-seed wiring (`select_suggested` top-5 no-floor → summary blocks, no full text in HIGH prompt), all-doc markdown summaries + NULL backfill (`summary_backfilled`, no `sources_meta` bump), `read` adds full text with `read_docs`-only dedupe, `done.sources` = suggested+read / durable record = suggested+related+read + `suggested=N` log line (seen live in E2E), byte-locked PERSONA/LOW/TOOLS_SECTION, battery gate PASS recorded in `TOOL_CALLING_TESTING.md` §10 (turbo 2026-09-16: 1/2/4 GREEN, cond-3 reported 9/10 per A7, contract 21/21, caps 0). - Defects fixed (all pre-existing, none phase-118): ① `ChatMessage` schema missing the phase-113 `related` key → `extra="forbid"` 422'd every done-time auto-save of grounded turns with a related tier, leaving `message_count=1` (root cause of `test_share_chat` 3F; browser-level instrumentation proved the PUT 422) — added the field + unit/integration pins; ② `test_theme_semantic_completion` pins stale vs phase-117 debox (border/chip removed) — re-targeted to assert border/chip absence; ③ `test_header_consistency` `<26`px pin red on 26.125px native date-input line — bound relaxed to `<34` (wrap-detection intent kept); ④ `test_navbar_refresh` bor.chat.v1 key set updated for `related`. - Test/lint/coverage: `uv run pytest --cov=app --cov-report=term-missing` → 2506 passed, app/ 99% (>90%); `uv run ruff check . && uv run pyright` → clean, 0 errors. - E2E: new story suite in isolation → 2 passed; full 103-suite matrix sweep (each isolated) → all 103 green after the fixes; `test_share_chat` 4 passed, `test_theme_semantic_completion` 8 passed, `test_header_consistency` 3 passed, `test_navbar_refresh` 7 passed. - Deviations: none from LOCKED decisions. Note: orphaned diagnostic uvicorn processes briefly made E2E sessions exercise stale code — killed and re-verified; a sweep-regenerated tracked screenshot was restored. No commits made (harness commits). - Completion criteria: all 7 ✅ (commit/phase-move is the harness's step). - Next pending phase: none — `todo/` holds only this phase's overview pending the harness move.	2026-09-16 06:57:49 -04:00
ducoterra	3846f26a58	phase: 114_embed_question_length Build and Push Containers / build-and-push-app (push) Successful in 2m6s Details Build and Push Containers / build-and-push-db (push) Successful in 13s Details All verification passes complete — the phase was already fully implemented in the working tree, and every gate is green. No defects found; no code changes were needed. Final verification pass — Phase 114 (embed question length): - Verified truncation: `chat.py:459` embeds `request.message[:settings.embed_question_max_chars]` (default 1200, `BOR_EMBED_QUESTION_MAX_CHARS`, `>0` validator); full question still reaches the LLM prompt/log. - Verified error mapping: `EmbeddingInputTooLargeError(EmbeddingError)` (byte-identical message) caught before `EmbeddingError` → no retry, terminal frame `detail="Question too long — trim it and re-ask."` + reachability-fine hint; `ChatErrorEvent.hint` additive. - Verified frontend chain: frame `hint` → `err.hint` → `setUiState(error, …, {hint})` → `showErrorBanner(…, {retryable: true})` — hint replaces default `ERROR_HINT`, phase-111 `#banner-retry` button revealed. 4,000-char clamp untouched (A2). - `uv run pytest tests/unit/test_embed_question_length.py -v --no-cov` → 21 passed - `uv run pytest tests/e2e/test_embed_question_length.py -v --no-cov` (isolation, DB up) → 1 passed (4,000-char question → done, no banner) - Regression: `test_llm_retry.py` 4 passed · `test_oneshot_llm_retry.py` 2 passed · `test_chip_sizing_question_cap.py` 6 passed - `uv run pytest --cov=app --cov-report=term-missing` → 2444 passed, TOTAL 99% (>90% gate) - `uv run ruff check .` → All checks passed; `uv run pyright` → 0 errors, 0 warnings Completion criteria: (1) 4,000-char question embeds prefix + full prompt ✅ · (2) too-large → accurate frame + hint + Retry button ✅ · (3) reachability failure byte-identical (retries + old copy) ✅ · (4) all gates green ✅ · (5) commit/phase-move → left to the harness per instructions (no `git add`/`commit` run). Deviations: none. Next pending phase: `115_doc_draft_discard`.	2026-09-15 04:16:55 -04:00
ducoterra	97d663d16d	phase: 113_source_chip_quality Build and Push Containers / build-and-push-app (push) Successful in 2m2s Details Build and Push Containers / build-and-push-db (push) Successful in 15s Details All gates green — no defects found; this pass was verification only. Phase 113 final verification pass — report - Verified (no code changes needed): `select_documents_tiered` cited/related tiering + `select_documents` wrapper, `TurnPlan.related_docs`, `ChatDoneEvent.related` (additive, old payloads parse), `appendRelated` UI row (`.related-doc`, never `.source-chip`), done-frame + restore-path wiring, two settings with validators, `.env.example` entries - `uv run pytest --cov=app --cov-report=term-missing` → 2422 passed, app/ coverage 99% (>90% gate) - `uv run pytest tests/e2e/test_source_chip_quality.py -v --no-cov` (isolated) → 2 passed - Regression E2E `test_retrieval_quality.py` + `test_honest_deflection.py` + `test_chat_rag.py` + `test_sources_midstream_bug.py` → 17 passed - `uv run ruff check . && uv run pyright` → clean (0 errors); `bash .agents/validate.sh` → "validation OK" Completion criteria: 1. Single-doc question → exactly one `.source-chip` (E2E): ✅ passed 2. Weak 2nd doc only in de-emphasized related row, never `.source-chip` (unit + E2E): ✅ passed 3. Deflected turn → zero citation chips, weak hits in related row: ✅ passed 4. Full suite green, coverage >90%, isolated E2E green, lint/types clean: ✅ passed 5. `--no-gpg-sign` commit + phase dir move: left to harness per pass rules (task files already in `complete/`) No deviations. Next pending phase: `114_embed_question_length`.	2026-09-15 03:11:05 -04:00
ducoterra	35d65d2f25	feat(rag): summarize single-document folders (MIN_DOCS_PER_FOLDER 2 → 1) Build and Push Containers / build-and-push-app (push) Successful in 2m10s Details Build and Push Containers / build-and-push-db (push) Successful in 13s Details Relax the phase-94 folder-summary scope rule from ≥ 2 documents to ≥ 1: a folder (or source root) is a candidate while ANY document lives under it, so single-file folders and single-file source roots get their own lite-written description. A row is now pruned only when its folder loses its last document (vanishes from the catalogue). The constant is the single source of truth, so the flip propagates to the generator's candidate set, the prune pass, the missing_folder_summaries gap probe (the next sync self-heals the new gaps), and the KB-tree summary_pending markers (1-doc folders / sources now read "Summary pending" until their row lands). Docstrings/comments across app/, scripts/import_docs.py, and the E2E fixtures updated to the ≥ 1 wording. Unit + integration tests updated to the new semantics (the pruned-below-minimum scenario is now a folder losing its LAST doc; single-doc folders are pinned as candidates/pending). Full suite: 2314 passed, app coverage 99%; ruff + pyright clean; folder-summary E2E stories pass in isolation (ls_tree_drilldown, sync_summary_visibility, kb_tree, kb_tree_nav, document_dates, oneshot_llm_retry).	2026-09-14 08:57:57 -04:00
ducoterra	ee3efb28c9	phase: 106_document_dates Build and Push Containers / build-and-push-app (push) Successful in 4m35s Details Build and Push Containers / build-and-push-db (push) Successful in 14s Details Everything is verified green. Final report: Phase 106 — Document dates (final verification pass; all 10 tasks already complete) - Verified all phase artifacts: alembic `0020` (dev DB at `0020`), `doc_dates.py`, git `file_commit_dates`, importer `doc_dates_by_root`/`dates_updated`, both entry-point wirings, date APIs + tree `created_at`/`updated_at`, LLM surfaces (prompt block, `read` line 2, appended `ls` field), `apply_recency_boost` in `retrieve()`, UI columns/badge, admin editor, mock-LLM regex — all present and correct; no defects found, no fixes needed. - `uv run pytest --cov=app --cov-report=term-missing` → 2299 passed, TOTAL 99% (>90% ✓) - `uv run pytest tests/e2e/test_document_dates.py -v --no-cov` → 6/6 passed in isolation (DB up) - 12 regression E2E suites (retrieval_quality, whole_document_context, agent_document_tools, ls_tree_drilldown, read_truncation_cap, kb_tree, kb_tree_nav, document_viewer, edit_summaries, import_documents, sync_button, hidden_folders_toggle, smoke) → all green in isolation - `uv run ruff check .` → clean; `uv run pyright` → 0 errors, 0 warnings Completion criteria: 1) non-null `created_at` + 0020 upgrade/downgrade on dev DB ✓ (real-Alembic integration tests) 2) sync refresh/older/manual-persists/content-reset/no sources_meta bump ✓ 3) zip/tar mtime + future→today ✓ 4) LLM date surfaces + cross-check ✓ 5) UI Created/Updated/badge positions ✓ 6) admin editor set+revert round-trip ✓ 7) old-correct-beats-new-similar (defaults & boost-off) + near-tie + `BOR_RECENCY_BOOST=0` byte-identical ✓ 8) full gate ✓ 9) commit/phase-move — left to harness per instructions. - Notable: recency default tuned 0.001 → 0.0007 (task 07 step 5 explicitly permits; measured margins recorded in `test_recency_boost.py` docstring). - Next pending phase: none — `todo/` holds only this phase.	2026-09-13 19:28:05 -04:00
ducoterra	f665a83b1a	phase: 98_sync_summary_visibility Build and Push Containers / build-and-push-app (push) Successful in 1m51s Details Build and Push Containers / build-and-push-db (push) Successful in 11s Details All verification complete. Final report: Phase 98 — Sync summary visibility: final verification pass (all 5 tasks already complete; implementation verified against the design, no defects found, no code changes needed) - Implementation checked: `SyncStatus` phase machine (4 new keys, terminal-keep counts), `on_progress` hook in `generate_folder_summaries`, `summary_pending` on `KbTreeSource`/`KbTreeFolder` + D3 rule in `build_kb_tree`, phase-aware sync labels + pending UI in `sources.js`, `.kb-summary-pending` CSS — all match decisions D1–D5. - Unit + integration: `uv run pytest` → 2184 tests, 0 failed/errors (exit 0) - Coverage: `uv run pytest --cov=app --cov-report=term-missing` → 99% on `app/` (criterion >90% ✓; `app/api/sync.py` and `app/rag/folder_summaries.py` at 100%) - Lint/types: `uv run ruff check .` → All checks passed; `uv run pyright` → 0 errors, 0 warnings - Phase E2E (isolation): `uv run pytest tests/e2e/test_sync_summary_visibility.py -v --no-cov` → 3 passed (phase machine, live label, pending markers + gap-fill self-heal) - Regression suites (each isolated, `--no-cov`): test_kb_tree ✓, test_ls_tree_drilldown 3 ✓, test_sync_button 3 ✓, test_sync_upload_progress 4 ✓, test_oneshot_llm_retry 2 ✓, test_local_directory_sources 3 ✓ - Completion criteria: all 7 verified green — status phase fields + terminal semantics; `Writing KB overview…`/`Summarizing folders… (n/m)` labels (title + aria-live); pending set == `missing_folder_summaries` (integration cross-check pinned at `test_docs_api.py:428`); CLI/`ls` byte-identity (no changes to those paths, pins green); suite/coverage/lint gates; dedicated + regression E2E. Commit left to the harness per protocol (no `git add`/`commit` run). - Decisions/deviations: none — no fixes were required this pass. - Next pending phase: `99_kb_tree_table_and_back_nav`.	2026-09-13 00:23:05 -04:00
ducoterra	d731169b8b	phase: 105_hidden_folders_toggle Build and Push Containers / build-and-push-app (push) Successful in 1m44s Details Build and Push Containers / build-and-push-db (push) Successful in 13s Details All completion criteria verified. Everything is green. Phase 105 final verification pass — all criteria verified - Verified the full implementation in the working tree: `git_sources.include_hidden` column + alembic `0019` (dev DB at head, column present), `iter_importable_files`/`import_sources` flag support with `str(root)`-keyed map used by both walk and progress pre-walk, `GitSourcePatchIn` rename with optional fields, sync/CLI pipeline wiring (OR-collision), and the per-row "Hidden" checkbox + tag + error line on the Sources page - Unit + integration: `uv run pytest` → exit 0 (2148 tests collected, all pass; this sandbox occasionally swallows pytest's final status line — exit codes verified) - Coverage: `uv run pytest --cov=app --cov-report=term-missing` → TOTAL 99% (3879 stmts, 15 miss) — >90% gate ✓ - Dedicated E2E: `uv run pytest tests/e2e/test_hidden_folders_toggle.py -v --no-cov` → 6 passed in 23.20s (DB up, in isolation) - Regression E2E in isolation: `test_source_ignore_paths` 6 passed, `test_git_sources_admin` 6 passed, `test_local_directory_sources` 3 passed, `test_sync_button` 3 passed, `test_smoke` 3 passed - Lint/types: `uv run ruff check .` + `uv run pyright` → clean (0 errors/warnings) Completion criteria: (1) checkbox persists via PATCH 200 → "hidden on" tag + GET round-trips `include_hidden: true`; failure path reverts box + `role="alert"` canned message ✓; (2) flag OFF byte-identical (only `visible.md` indexed), ON indexes `.hidden/note.md` into the KB catalog, `EXCLUDED_DIRS` excluded both states ✓; (3) A2: flag OFF → `detail.pruned==1`, doc gone from catalog ✓; (4) PATCH bool-only/list-only/both/neither no-op, phase-89 fixed 422s unchanged, 404, anonymous 403 (incl. bool-only body) ✓; (5) env-fallback rows render no checkbox, WCAG-clean (aria-label, keyboard focus, visible label, text tag) ✓; (6) full gate green ✓; (7) commit left to the harness per instructions (no `git add`/`commit` run; phase files untouched). Deviations: none — no defects found; no code changes were needed on this pass. Next pending phase: `.agents/phases/todo/98_sync_summary_visibility`.	2026-09-12 21:26:30 -04:00
ducoterra	4dbac1660a	phase: 101_tokens_page_overhaul Build and Push Containers / build-and-push-app (push) Successful in 1m49s Details Build and Push Containers / build-and-push-db (push) Successful in 13s Details All gates verified green — no defects found, nothing to fix. Final report: ## Phase 101 — final verification pass (all tasks already complete; verified, not re-implemented) Verified against the working tree (task files 01–04 present in `complete/`): - Active/revoked table split (Status column gone, section hidden while 0 revoked, per-table search with query state surviving re-renders) in `frontend/index.html` + `tokens.js` - `generateToken()` refuses blank/whitespace names (`Give the token a name first.`, no request); `\|\| "token"` fallback deleted - Atomic rotation: `regenerate_token` service + `POST /api/tokens/{id}/regenerate` (201 new-plaintext-once / 404 / 409 / router-wide 403) + `TokenListItem.revoked_at` (D5) - Regenerate two-step confirm UI + CSS (`.token-regenerate`, neutral hover, no new hue); A4 pins intact Test / lint / coverage results: - `uv run pytest` → 2065 passed - `uv run pytest --cov=app --cov-report=term-missing` → TOTAL 99% (>90% ✓) - `uv run ruff check . && uv run pyright` → clean (0 errors) - `uv run pytest tests/e2e/test_tokens_page.py -v --no-cov` → 4 passed (isolation, DB up) - Regression, each in isolation: `test_api_tokens.py` 9 passed, `test_admin_auth.py` 6 passed, `test_shared_header.py` 6 passed, `test_theme_semantic_completion.py` 8 passed (its revoked-pill pin was correctly re-scoped to the revoked table in this phase) Completion criteria: 1 ✓ split+search (E2E 1–2) · 2 ✓ required name (E2E 3 + source pin) · 3 ✓ rotation end-to-end, old token refused at gate (E2E 4 + API 404/409 pinned) · 4 ✓ A4 holds (list carries no plaintext/hashes) · 5 ✓ suite/coverage/lint green · 6 ✓ E2E + regressions green in isolation · 7 commit left to the harness per executor rules (all changes uncommitted in the working tree) Deviations: none. Next pending phase: `98_sync_summary_visibility`.	2026-09-12 15:16:02 -04:00
ducoterra	ad7585d474	phase: 97_kb_tree_catalog Build and Push Containers / build-and-push-app (push) Successful in 2m11s Details Build and Push Containers / build-and-push-db (push) Successful in 11s Details All completion criteria verified — everything is green, no defects found. Final report: ## Phase 97 final verification pass — ALL GREEN Verified (no code changes needed): - `GET /api/docs/tree` (admin), `build_kb_tree` pure builder, `PATCH /api/folders/summary`, migration 0018 (`manually_edited`, head confirmed), generator skip/keep + `kept_manual` stat, RAG tree UI + edit affordance in `sources.js`/`index.html`/`styles.css` - `tests/e2e/test_kb_tree.py`: 8 passed — top level, drill source/folder, edit round-trip, clear, manual-desc-survives-sync, reload fallback, anonymous gate - Integration: tree shape/order/403/empty/indexed-only + PATCH update/create/root/clear/404/403/no-LLM + stat-walk equivalence (in `test_docs_api.py`); 3-field `folder_summaries=` import token preserved Gates (exact commands): - `uv run pytest --cov=app --cov-report=term-missing` → 2053 passed, TOTAL coverage 99% (>90% ✓) - `uv run ruff check . && uv run pyright` → All checks passed / 0 errors - `uv run pytest tests/e2e/test_kb_tree.py -v --no-cov` → 8 passed in isolation - 30 story/RAG-view E2E suites run one per process: all passed, incl. `test_ls_tree_drilldown` (agent `ls` byte-identical ✓), `test_import_documents`, `test_edit_summaries`, `test_admin_auth`, `test_kb_overview` Completion criteria: tree view ✓ · edit round-trip + clear ✓ · manual persists/clear resets ✓ · `ls` unchanged ✓ · pytest/coverage/lint ✓ · E2E isolation ✓ · commit — left to harness per protocol (working tree untouched, `git add/commit` not run) Deviations: none. Next pending phase: none — `todo/` contains only 97 (96 already committed).	2026-09-11 22:48:02 -04:00
ducoterra	bcaef800c5	phase: 95_read_truncation_cap Build and Push Containers / build-and-push-app (push) Successful in 1m38s Details Build and Push Containers / build-and-push-db (push) Successful in 12s Details All gates are green. Final verification is complete — no fixes were needed; the phase is fully implemented and passing. Phase 95 final verification report - Verified all 3 tasks already implemented (task files in `complete/`): read cap + notice + `ToolResultPiece` (task 01), `tool_result` SSE + live/saved/shared marker (task 02), E2E suite (task 03). - Code checks passed: `BOR_READ_MAX_CHARS` (default 128 000, validator), pinned `READ_TRUNCATION_NOTICE` + `TRUNCATION_MARKER`, byte-identical at/under-cap read, holder `read_truncations` (no `tool_calls` impact), piece order (after `tool`, before next round), `ChatToolResultEvent`, `ToolCall` back-compat fields, `app.js` live/restore handlers, `shared.js`, `.truncated-note` CSS, `.env.example` entry, mock-LLM echo script. - Tests: `uv run pytest` → 1966 passed; `uv run pytest --cov=app --cov-report=term-missing` → all green, TOTAL 99% (>90% gate). - E2E: `uv run pytest tests/e2e/test_read_truncation_cap.py -v --no-cov` → 3 passed (frame order + live marker + LLM notice via echo; save→shared fidelity; short-read control). - Regression (isolated): `test_agent_document_tools` 4 ✓, `test_chat_history` 5 ✓, `test_share_chat` 4 ✓, `test_big_read_progress` 4 ✓, `test_stop_generation` 3 ✓. - Lint/types: `uv run ruff check .` → All checks passed; `uv run pyright` → 0 errors, 0 warnings. Completion criteria: ① over-cap read → first-cap-chars + marker + pinned notice — ✓ (unit-pinned: at-cap/cap+1/notice tests); ② user marker live/saved/shared — ✓ (E2E + frontend tests); ③ at/under cap byte-identical, no frame — ✓ (unit + control E2E); ④ top-2 `<documents>` retrieval untouched — ✓ (`app/rag/retriever.py` unmodified vs HEAD); ⑤ suite green, >90% coverage, ruff+pyright clean — ✓; ⑥ no completed-phase behavior change — ✓ (all gates green; commit left to harness per pass rules). - No defects found; no changes made this pass. Next pending phase: none in `todo/` (96 is the next free number).	2026-09-11 03:42:51 -04:00
ducoterra	9188be259b	phase: 93_theme_semantic_completion Build and Push Containers / build-and-push-app (push) Successful in 1m56s Details Build and Push Containers / build-and-push-db (push) Successful in 11s Details All verification is complete. Final report: Phase 93 — Theme semantic completion: FINAL VERIFICATION PASS — ALL GREEN - Verified full implementation in tree: migration `0016` (8 nullable semantic columns, applied at head), 17-var `BUILTIN_COLORS`/`COLOR_FIELDS`/`effective_settings`, API validation, `#view-theme` State-colors fieldset (17 pickers), `theme.js` FIELDS/PAIRS (5→8), `.page-head` surface panel (6 shell views + doc-edit + shared.html; login card / document sticky header audited as already-surfaced), mock_llm `content: None` fix - Fixed 2 pre-existing defects (both fail identically on baseline `d4f38ad`, proven via worktree A/B): `test_nav_rename_sources` — expected nav tail missing the phase-91 "Theme" link; `test_stale_ui_copy` — now truncates `saved_chats` before/after (house `test_suggestion_chips` pattern) so the seed-chip contract is deterministic on the shared dev DB (owner's 22 saved chats triggered phase-80 last-3-questions) - Tests: `uv run pytest --cov=app --cov-report=term-missing` → 1868 passed, app/ 99% (>90% ✓); `uv run ruff check .` → clean; `uv run pyright` → 0 errors - E2E: dedicated `uv run pytest tests/e2e/test_theme_semantic_completion.py -v --no-cov` → 8/8 in isolation (all-gray 17-color theme: zero residual color on saved-result/Stale/Revoked/Local/tool-call elements, text labels intact, gray heads non-transparent, pre-paint tag, Reset → byte-identical no-tag); 15 theme/header/nav/responsive suites green in isolation; full 85-file combined run: only the 2 fixed pre-existing failures + 1 combined-run artifact (`test_sync_upload_progress`, green in isolation) - Completion criteria: (1) monochrome E2E ✓ (2) default byte-identical, no `#bor-theme` tag ✓ (3) all page heads on solid surface ✓ (4) suite/coverage/lint/E2E green ✓ (5) phases 01–92 no behavior change ✓ (6) commit left to harness per protocol - Notable: cleaned stray uvicorn leftovers from prior implementation pass (owner's `--reload` dev server untouched); no deviations from the phase design - Next pending phase: `94_ls_tree_drilldown`	2026-09-10 16:43:08 -04:00
ducoterra	df91c6316c	phase: 92_theme_save_and_coverage Build and Push Containers / build-and-push-app (push) Successful in 1m47s Details Build and Push Containers / build-and-push-db (push) Successful in 11s Details Phase 92 final verification pass — all green. This pass re-verified the completed tasks (all 5 task files already in `complete/`) against every completion criterion; no defects found, nothing to fix. - Verified: 9th identity var `grid_line` end-to-end (migration `0015` at head, model/`theming.py`/schemas/API, 422 + built-in→NULL tests present); `styles.css` zero hardcoded literals outside `:root` + derived `--brand-` vars; 9th picker in theme form; wordmark themed; `theme.js` save/reset/re-show/mount live-sync; dedicated E2E suite + phase-91 suite updated. - `uv run pytest --cov=app --cov-report=term-missing` → 1845 passed, exit 0, TOTAL 99%* (>90%) - `uv run ruff check .` → clean; `uv run pyright` → 0 errors, 0 warnings - `uv run pytest tests/e2e/test_theme_save_and_coverage.py -v --no-cov` → 3 passed (save-live, reset-live, whole-site) - `uv run pytest tests/e2e/test_admin_theme_tab.py -v --no-cov` → 5 passed - Criteria: (1) Save/Reset repaint open page, no nav, SPA-nav survives, pre-paint intact ✅; (2) both `rg` gates green (only `:root` + documented `#fff` Stop label; zero SVG hex attrs), grid/selection/hovers/wash/wordmark E2E-proven ✅; (3) no-op contract live-checked: row-less `/` = no tag + exact A1 CSP, grid-only row = 9-var tag in `COLOR_FIELDS` order + sha256 CSP, with-row ≡ row-less bytes ✅; (4) full suite/coverage/lint/both E2E ✅; (5) commit left to the harness per instructions. - Deviations (previously made, probe-verified, kept): live repaint uses CSSOM `<html>` overrides because Chromium blocks `<style>` textContent mutations under the locked sha256-only CSP (tag text still mirrors the next load; `<html>` style exact-saved after Save, empty after Reset); wordmark themed via 3 `.brand-mark` CSS rules instead of inline styles (task 03's inline attrs were CSP-blocked — fixed during task 04). - Next pending phase: none — `todo/` contains only `92_theme_save_and_coverage`.	2026-09-10 00:23:08 -04:00
ducoterra	d22d260b8b	phase: 91_admin_theme_tab Build and Push Containers / build-and-push-app (push) Successful in 5m43s Details Build and Push Containers / build-and-push-db (push) Successful in 12s Details All verification is complete — this pass needed no code changes. Final report: Phase 91 — Admin Theme tab: final verification pass (all 6 tasks already in `complete/`) - Verified pre-paint theming end-to-end: `ui_settings` store + resolver, admin `GET/PUT /api/ui-settings`, `CachingMiddleware` inline-`<style id="bor-theme">` injection before `</head>` (incl. `/shared/<token>` prefix branch, unit-pinned), CSP sha256 exemption for the inline tag, Theme tab shell + `theme.js` editor, CSS-file theming fully retired. - No defects found; zero changes made — working tree left exactly as the task executors left it. - Tests: `uv run pytest --cov=app` → 1841 passed, 0 failed (TOTAL coverage 99%; theming/ui_settings/caching all 100%); `uv run pytest tests/e2e/test_admin_theme_tab.py -v --no-cov` → 5 passed in isolation. - Lint/types: `uv run ruff check .` → All checks passed; `uv run pyright` → 0 errors, 0 warnings. - Criteria: (1) unset deployment byte-identical, no `#bor-theme` anywhere — ✓ (unit no-op test + E2E reset byte-compare); `rg "BOR_THEME\|themes/"` → single hit is the permitted doc-history comment in `frontend/index.html`. (2) admin-only gate + 403s for anonymous and token users — ✓ (E2E test 3). (3) saved theme inline before `</head>` on every page incl. `/shared/<token>`, computed `--brand` on first paint for admin + anonymous — ✓ (E2E test 2 + unit). (4) reset → byte-identical; 5 contrast pairs warn <4.5:1, non-blocking — ✓ (E2E tests 4–5). (5) suite green, >90% coverage, lint clean — ✓. (6) commit deferred to harness per rules. - Notable: `.agents/PLAN.md` is absent from the repo — the phase overview's Design section was used as the binding spec; no deviation resulted. - Next pending phase: none — 91 is the last phase in `todo/`.	2026-09-09 17:22:24 -04:00
ducoterra	3095c4c577	phase: 90_upload_no_scan All verification is complete and green. Final report: Phase 90 (upload_no_scan) — final verification pass: all criteria verified, no fixes needed - Verified (not re-implemented): all 3 tasks already complete; working tree carries the phase's uncommitted changes - Upload pipeline: `_run_upload` stops after row upsert; success = `{"message": "uploaded"}`, null/0/0 progress; `UploadOut` removed from `app/schemas.py`; gates/unpack/swap/failed states intact - Copy: button "Upload", bare "Processing…", result line "Uploaded \<name\> — press Sync sources to import it."; hint + caption re-pointed at Sync; no "Upload &" remnants in `frontend/` - Tests: `pytest tests/unit/test_git_sources.py tests/integration/test_git_sources_upload.py tests/unit/test_frontend_sync_upload.py` → 56 passed; E2E phase suite `tests/e2e/test_upload_no_scan.py` → 3 passed (zero docs after upload; ignore edit honored by Sync — 2 added, `notes/skipme.md` excluded; re-upload in-place, still zero docs); affected suites `test_archive_upload_sources.py` + `test_sync_upload_progress.py` + `test_source_removal_cleanup.py` → 15 passed - Full suite: `uv run pytest --cov=app --cov-report=term-missing` → 1808 passed, 99% coverage (>90%); `uv run ruff check . && uv run pyright` → clean, 0 errors Completion criteria: 1. Upload settles "ready for sync", zero docs, row + ignore editor — ✅ (E2E test 1) 2. Button "Upload", no "Upload &" copy — ✅ (`rg` empty in frontend/, app/, tests/) 3. RAG-page "Sync sources" imports upload honoring edited ignores — ✅ (isolated E2E test 2) 4. Suite green, >90% coverage, lint clean — ✅ (99%, ruff+pyright clean) 5. Atomic commit — ✅ left to harness per executor rules (no git add/commit run; tree staged-ready) Deviations: `regenerate_overview` still appears once in `git_sources.py` — inside `delete_git_source` (phase-69 locked total-removal behavior, not the upload leg; upload leg is scan-free). `.agents/PLAN.md` does not exist in this repo; locked decisions A1–A4 were enforced from the phase files. Next pending phase: `91_admin_theme_tab` (in `todo/`).	2026-09-09 14:08:18 -04:00
ducoterra	8c706259e9	phase: 89_source_ignore_paths Build and Push Containers / build-and-push-app (push) Successful in 1m44s Details Build and Push Containers / build-and-push-db (push) Successful in 13s Details All verification complete — TODO.md was already cleared in the roadmap commit; the two extra unit-test diffs are necessary fake-signature adaptations for the new keywords. Everything is green, no fixes were needed. ## Phase 89 — final verification pass: ALL GREEN Verified (all 6 task files present in `complete/`): - `git_sources.ignore_paths` JSONB column + migration 0013; `alembic downgrade -1 && upgrade head` round-trips (head `0013`) - Importer: `normalize_ignore_path`/`is_ignored`/`_ignore_for_root`, `ignore` in walk + progress pre-walk, `ignore_by_root` in `import_sources` - API: GET/POST carry list; admin-only `PATCH` (replace, 404/422 fixed details, anonymous 403) - Pipelines wired: `_run_sync`, `_run_upload` re-upload, `scripts/import_docs.py` - Sources-page box: dialog, §7.4 save lifecycle, `N ignored` tag, a11y; env rows get no box Test/lint results: - `uv run pytest` → 1808 passed - `uv run pytest --cov=app --cov-report=term-missing` → TOTAL 99% (>90%) - `uv run pytest tests/e2e/test_source_ignore_paths.py -v --no-cov` → 6 passed (isolated, DB up) - Regressions in isolation: `test_git_sources_admin` 6, `test_archive_upload_sources` 5, `test_sync_button` 3, `test_smoke` 3 — all passed - `uv run ruff check . && uv run pyright` → clean (0 errors) Completion criteria: box→PATCH 200→count+GET round-trip ✅ · sync excludes `ignore/` (no docs/chunks/embeddings/summaries) + prunes newly-ignored (pruned==2) ✅ · no-mid-path rule E2E ✅ · PATCH 404/422/replace/clear/403 ✅ · full gate green ✅ · commit + phase move left to harness per rules. Deviations: none blocking — E2E pins `files == 4` (overview's "5" was an off-by-one vs its own 6-file tree, documented in-test); `tests/unit/test_importer.py` + `test_sync_button.py` test-double fakes extended for the new keywords (needed for the suite to stay green). Next pending phase: none — `todo/` holds only this phase.	2026-09-09 01:45:42 -04:00
ducoterra	fa189dede7	phase: 83_chat_save_payload_limits All verification criteria are confirmed green. Final report: Phase 83 — final verification pass (all tasks already complete; verified, nothing to fix) - Verified `app/schemas.py` carries every A1 cap (text/thinking 32 000, sources 20, suggestions 50×200, tools 50, SourceRef 120/1000/500, ToolCall 100/2000, messages ≤200) — boundary-only, `app/api/chats.py` untouched - Verified all test pins exist and pass: 32 unit boundary tests (both edges of every cap + round-trip), 4 oversized-422 integration pins (text/201-msgs/21-sources/PUT, each with nothing-stored/row-unchanged assertions), A3 SSE done-event pin at column maxima, dedicated E2E (anon 40 000-char POST → 422 + small save → 201) - `uv run pytest tests/unit/test_schemas.py -v` — 32 passed - `uv run pytest tests/integration/test_chats_api.py` — exit 0; A3 pin — passed - `uv run pytest tests/e2e/test_chat_save_payload_limits.py -v --no-cov` — 2 passed (isolation); `uv run pytest tests/e2e/test_chat_history.py -v --no-cov` — 5 passed - `uv run pytest` — exit 0 (~1 704 tests, 0 fail/skip); `uv run pytest --cov=app` — TOTAL 99%, `app/schemas.py` 100% (>90% ✓) - `uv run ruff check . && uv run pyright` — clean (0 errors) - `git diff --stat` — only `app/schemas.py`, 3 test files (+`test_chat_api.py` A3 pin, sanctioned by task 02), phase files; no `app/api/chats.py`/`alembic`/`frontend`/`pyproject`/`uv.lock` diff ✓ - All completion criteria met; commit + phase move left to the harness per pipeline rules (changes stay in working tree) - Deviation note: list caps use `max_length` instead of `max_items` — identical in pydantic 2.13 (`max_items` is a deprecated alias); both boundaries behaviorally pinned - Next pending phase: `84_docs_push_error_sanitization`	2026-09-08 00:33:21 -04:00
ducoterra	7fce6572d0	feat: phases 77–80 — navbar view refresh, static background, API tokens, history suggestion chips Build and Push Containers / build-and-push-app (push) Successful in 1m45s Details Build and Push Containers / build-and-push-db (push) Successful in 13s Details Single consolidated commit for four completed, validated phases (77, 78, 79, 80). The pipeline run left all work uncommitted because the harness commits only with PHASE_COMMIT=1 while child executors are forbidden from committing; the phases themselves all passed validation and moved to .agents/phases/complete/. Phase 77 — navbar view refresh - router.js dispatches bor:view-refresh on re-show / active re-click / popstate (gated on wasMounted; first show and boot exempt) - History / RAG / Sources / Tuning re-fetch on refresh (admin branch); Chat deliberately excluded (stream survival) - History "Refresh" button (admin-only, in-flight disable + status line) - New story suite tests/e2e/test_navbar_refresh.py (7 tests) Phase 78 — static background - Removed the animated glow layers; static 44px grid over the flat --bg canvas; default and reduced-motion renders byte-identical - Updated background/theme E2E suites; removed bg-glow test pins Phase 79 — API tokens - api_tokens model + migration 0012; hash-only token service - Admin tokens API + Tokens admin view; POST /api/token-auth; live-revoking require_user on chat / suggestions / document content - Frontend token gate with localStorage cache; anonymous E2E suites migrated to token login - New story suite tests/e2e/test_api_tokens.py (9 tests) Phase 80 — history suggestion chips - last_questions() endpoint with SEED fallback; startNewChat() refetch - Seed-semantics docs (config.py, .env.example, README) - Integration state matrix + E2E suite rewritten to the 4 chip states Also included: phase-76 report artifacts and the repo restore-test-db skill (previously untracked), scripts/* ruff fixes from phase 77. Final gate state (phase 80 final pass, covers everything above): - uv run pytest --cov=app → 1637 passed, 0 failed, app/ coverage 99% - uv run ruff check . && uv run pyright → clean, 0 errors - Per-phase story E2E suites green in isolation	2026-09-07 12:39:01 -04:00
ducoterra	ffa919b8bf	fix(chat): keep in-flight answers alive across in-app view switches Root cause (owner repro, verified in a real browser 2026-09-06): the five navbar views (Chat, RAG, Sources, Tuning, History) were separate HTML documents, so a navbar click was a REAL cross-document navigation — the chat page unloaded, the in-flight SSE fetch was aborted, and the phase-48 teardown (app/api/chat.py `finally`, "chat: turn cancelled") stopped the model. Observed: send question -> click RAG mid-stream -> click Chat -> the answer never finished: no `query_log` row, and on return a dangling question with no brain record (the pre-token pagehide partial persist skips because `acc` is empty). Phase-48 LOCKED-DECISION REFINEMENT (owner-confirmed 2026-09-06, flagged per AGENTS.md rule 3, not silently deviated): "real navigation cancels the fetch" now means LEAVING THE APP — tab close, external/other-document navigation, the Stop button. In-app navbar switches are client-side view switches and no longer cancel. Fix — Option A (SPA shell), chosen over B (Service Worker owns the stream) and C (server-side turn registry + resume): - frontend/index.html is the shell: ONE `<main id="main">` holds the five `<section class="view">` blocks; hidden views carry BOTH `hidden` and `inert` (WCAG — no focus/keyboard traversal). The shared header, the single `doc-modal-` skeleton, and the `#app-version` footer each exist exactly once; the per-view copies from the four folded pages are dropped. - New frontend/assets/router.js (vanilla module — no framework, no bundler, No-CDN rule intact): lazy-imports a view module on FIRST show only (mount-once, hide-forever — the chat view's in-flight SSE reader persists across switches; that persistence IS the fix); intercepts same-shell navbar links with preventDefault + history.pushState (never a document load); handles popstate; single writer of `.nav-link` active state (is-active + aria-current), document.title, and the per-view meta description (values carried over from the old pages' heads, brand-resolved at write time). - Each folded page's JS becomes `export async function mount(root)` — root-scoped queries; `initSharedHeader()` dropped (the header boots once in the shell via the chat module; the admin flag comes from the same cached `fetchIsAdmin()` promise — zero extra requests). - app/main.py: a small list-driven route factory serves the shell for /tuning.html, /sources.html, /git-sources.html, /history.html — registered AFTER the API routers and BEFORE the static catch-all (routes-first). The phase-33 caching middleware applies no-cache + `?v=` rewriting unchanged; app/core/caching.py needed NO change (the view paths did not change — pinned by the integration tests). - The four old view .html files are DELETED (one source of truth); deep links to the old URLs keep working (the router picks the view from the pathname); `/?chat=<id>` is unaffected; the Containerfile bundles router.js (inlining the lazy view modules) and drops the folded page files. - app/schemas.py: HistoryTurn.text cap 4000 -> 32000 — the shell keeps long saved answers in the chat, and the old cap (stricter than the 24_000-char total history budget) 422-rejected any second turn in such a chat (found by the phase-42 E2E suite on the shell). Boundaries: login.html, shared.html, doc-edit.html, document.html REMAIN separate documents (flow pages, not navbar tabs); a mid-stream navigation to doc-edit/document.html still cancels per phase 48 (follow-up candidate, out of scope). The SSE API is unchanged. Real departures still cancel the turn — phase 48 intact (pinned by tests/e2e/test_stop_generation.py, unchanged, and by the new suite's real-departure control). Tests: - Phase-20 suite REWRITTEN to the new semantics (tests/e2e/test_sources_midstream_bug.py): a navbar switch no longer cancels — the stream survives the switch and the FULL answer settles; the pagehide partial persist REMAINS for real departures (the partial's exact shape — first streamed chunk prefix, no done metadata — is still pinned there). - NEW story suite tests/e2e/test_nav_switch_keeps_stream.py (mock LLM): the owner repro (send -> RAG mid-stream -> Chat: window sentinel survives = same document, FULL answer, exactly one brain turn in bor.chat.v1, exactly one settled query_log row, auto-saved row matches) + the same mid-stream switch against the other three views + the real-departure-still-cancels control + the no-switch baseline. - tests/unit/test_frontend_router.py: source-level pins of the router invariants (click interceptor targets ONLY same-shell view paths, pushState-only switches, mount-once guard, hidden+inert pair, single-writer active state/title); shell-route integration tests (each folded path serves the shell with no-cache + `?v=` body; a non-view path still 404s); the file-reading unit pins re-pointed at the shell (the four view files are gone — the shell is the source of truth). Verification (this commit): full suite green — 1565 unit+integration tests, app/ coverage 99% (>90% floor); ruff + pyright clean; the phase's E2E suites green in isolation (house protocol, AGENTS.md rule 9). Owner repro verified in a real browser against the real LLM (dev server :8010, headful Chromium): "tell me about everquest" -> RAG mid-stream -> Chat — the answer completed with one brain bubble and no error banner, `query_log` gained exactly one settled row (deflected=True: the dev KB holds no EverQuest docs — the settle, not the topic, is the proof), zero "chat: turn cancelled" lines for that turn; the control (real navigation to /shared.html mid-stream) still cancelled (no settled row, the cancel line logged, the partial persisted on return). Screenshots: .agents/screenshots/76_manual_. Phase 76 (76_spa_nav_shell) complete — moved to .agents/phases/complete/.	2026-09-06 06:31:31 -04:00
ducoterra	055c0b5d85	feat(rag): pass chat history with prior thinking to the LLM Build and Push Containers / build-and-push-app (push) Successful in 1m39s Details Build and Push Containers / build-and-push-db (push) Successful in 11s Details Phase 74 (TODO.md L4): a follow-up question now reaches the model WITH the conversation so far — every prior user/brain turn and the prior thinking blocks on brain turns (preserve-thinking) — while POST /api/chat stays stateless (A10): the client provides the history in the request body and the server stores nothing new. Server (task 01): - ChatRequest.history: optional list[HistoryTurn] (who: user\|brain, text, optional thinking) — absent/empty keeps the request byte-identical to pre-phase-74 (the two-message [system, user] request; the kill-switch semantics are pinned in the integration suite). - app.rag.prompts.history_to_messages: pure mapper — walks the turns newest-first against the settings budgets (history_max_turns=40 / history_max_chars=24000, BOR_HISTORY_MAX_TURNS / BOR_HISTORY_MAX_CHARS); a capped turn is dropped WHOLE (never cut mid-answer); the kept window is returned oldest-first; brain turns carry their thinking as reasoning_content (A4) only when non-empty. - Both branches feed it: the deflected path splices it between the system prompt and the current user message (the phase-71 recovery still rebuilds from messages[1:]), the grounded agent receives run_agent(..., history=hist); llm.py's message params widen to list[dict[str, Any]] (string-only messages stay byte-identical on the wire — the SDK passes message dicts through verbatim). - The per-turn log line (PLAN §9) gains history_msgs=N after kb_chars=N. - Pins: tests/unit/test_history.py (mapper: mapping, reasoning gating, both budgets, drop-whole, ordering, empty default), tests/unit/test_config.py (the two settings + env overrides), tests/unit/test_agent.py (the history splice + the default), tests/integration/test_chat_api.py (deflected AND grounded forward the history incl. reasoning_content, no-history byte-identity, 422 pins, the log field). Client (task 02): - runTurn — the single funnel for fresh send / phase-49 retry / phase-53 stale-regen — sends history = the conversation record minus the current question, with thinking only on brain records that streamed one (undefined drops the key from the JSON, the record's convention); the question is never duplicated into the history. Wire proof (task 03): - The mock's echo my history marker (HISTORY_TRIGGER) answers with the deterministic history echo — history: N prior messages; last answer tail: <last 24 chars>; thinking: yes\|no — checked BEFORE the DEFLECT_MODE branch (like TABLE_TRIGGER), so it fires on both turn branches whatever the gate says; the module docstring records the user/assistant-only history invariant that keeps every existing (tool-result-classified) marker flow unaffected. - tests/e2e/test_llm_history.py (isolated): a grounded follow-up and a deflected follow-up both receive history: 2 prior messages + thinking: yes + the byte-exact tail of turn 1's answer (derived from the persisted bor.chat.v1 record — the same array the client maps into the body); a cold start receives history: 0 prior messages / last answer tail: none / thinking: no. - Regressions green in isolation: chat_rag, chat_history (phase 50), agent_document_tools, harness_aligned_tools, stop_generation, retry_answer, response_to_docs.	2026-09-05 16:04:40 -04:00
ducoterra	801639efcc	feat(agent): align the document tools with the harness-trained shape — ls, read(path), grep(pattern, path?)	2026-09-03 11:17:47 -04:00
ducoterra	8cf3a827ee	feat(agent): search_documents tool — the model can grep the indexed documents for an exact string Build and Push Containers / build-and-push-db (push) Canceled after 0s Details Build and Push Containers / build-and-push-app (push) Canceled after 1m11s Details	2026-09-02 12:04:34 -04:00
ducoterra	88293ed02f	feat(rag): retry a failed LLM request before the first token lands — BOR_LLM_RETRIES/BOR_LLM_RETRY_DELAY with a live 'retrying' status	2026-09-02 10:52:38 -04:00
ducoterra	4677d86f49	feat(sources): real-time file progress for sync and upload — background upload with success toast	2026-09-01 23:51:43 -04:00
ducoterra	725af9fac1	feat(docs): save chat answers as docs — edit screen, commit + push to the .env docs branch	2026-09-01 03:52:03 -04:00
ducoterra	140b97ebf3	feat(kb): edit + re-embed document summaries from the viewer (admin)	2026-08-31 23:52:22 -04:00
ducoterra	32b7bfd4b3	feat(chat): invalidate saved chats on sources sync — versioned stamps, stale marker, Regenerate against the new index	2026-08-30 23:39:15 -04:00
ducoterra	114b115034	feat(chat): share a chat by link — anonymous read-only /shared/<token> page, share/unshare	2026-08-30 01:34:44 -04:00
ducoterra	ece93a7c8f	feat(chat): save and view chat history — admin-only saved_chats, History page, open-a-chat return	2026-08-29 21:22:25 -04:00
ducoterra	03d26255c6	feat(sources): upload tarball/zipfile archives as sources — unpack, scan, and replace in place Phase 49 (owner request, chat 2026-08-28: "The git sources page should remove local directory and should instead accept a tarball or zipfile upload which it will unpack and scan … reuploading the same tarball should not create a new folder, but should unpack and overwrite the previously unpacked content" — design confirmed in the same conversation): * POST /api/git-sources/upload (admin-only, require_admin): accepts .tar/.tar.gz/.tgz/.zip, streams it with the BOR_UPLOAD_MAX_MB cap (bounds BOTH the compressed upload and the total extracted bytes — zip-bomb guard), safely unpacks (absolute/traversal/symlink/hardlink escape and device/FIFO members rejected), and atomically swaps the content in over BOR_UPLOAD_DIR/<name>/ (name = filename minus the archive suffix — no missing window, a failed upload never touches the existing folder/row/KB). The git_sources row is upserted by path (kind='local', no duplicates, added_at preserved), the models are checked fail-fast (503 sanitized when down — the folder/row stay committed and the next sync/re-upload retries idempotently), and the source is scanned synchronously in the request (single-source import_sources prune=True + change-gated KB overview), answering 200 with the sync-style counts. One upload at a time (409); the request session is released before the scan so a concurrent TRUNCATE cannot deadlock against it. * app/rag/archive_upload.py: ArchiveUploadError, ARCHIVE_SUFFIXES, archive_source_name (safe-name derivation), unpack_archive (guarded zip/tar extraction with the extracted-byte cap, no partial state), swap_in (atomic replace with restore-on-failure) — fully unit-tested. * app/config.py + .env.example: BOR_UPLOAD_DIR (default ~/bor-sources/uploads, deliberately separate from the git checkouts) and BOR_UPLOAD_MAX_MB (default 512; a validator fails loud at startup on <= 0). * python-multipart added to the dependencies — FastAPI's required multipart parser (an A2 implementation detail, phase locked decision). * The Sources page: the phase-38 "Add a local directory" form is removed; #archive-upload-form takes its place (labeled file input, "Upload & scan" button, the §7.4 never-stale lifecycle, inline role=alert error, role=status count line); hint + table caption updated. The POST /api/git-sources kind=local API contract is UNCHANGED — a plain directory is still registrable via the API, and existing Local rows list/remove/sync exactly as before. * The phase-38 story E2E (test_local_directory_sources.py) is rewritten API-driven — the form it drove is gone; its acceptance stands. * The story E2E (test_archive_upload_sources.py): the swap, upload→scan→list (the deterministic "Uploading…" in-flight state, the Local row, /api/docs + the RAG catalog), same-filename re-upload (in-place replace, prune, no duplicate row, v2-only folder), the 422 inline error + recovery (the form is not wedged), and the anonymous gate + 403. * README: the archive-upload section (formats, naming rule, in-place replace, both new settings), the local-directory form removal noted, config reference rows for BOR_UPLOAD_DIR / BOR_UPLOAD_MAX_MB. Gates: unit+integration green, app/ coverage 99%, the story E2E green in isolation, the regression suites (git sources admin, local directory sources, sync button, import documents, nav rename, smoke, shared header) green in isolation, ruff + pyright clean. Note: per this phase's file-level staging, frontend/assets/styles.css also carries the small same-day in-flight owner rework already in the working tree (the .sign-in-mobile companion rule for the phase-48 mobile sign-in copy); the phase-49 change is the upload form's block.	2026-08-28 15:57:59 -04:00
ducoterra	94d7228510	feat(admin): local directory sources — kind/path on git_sources, combined sync + import, page form + badges An existing, non-git directory is now a first-class source alongside the git repos: one table (git_sources + kind discriminator — A13 reversible migration), one admin page, one Sync button (phase locked decisions; the phase-35 table is extended, not duplicated). The DB is the local-source registry — no env var for local paths; BOR_GIT_SOURCES stays a git-only empty-table fallback. Migration 0007 (reversible, up/down integration-tested): git_sources.kind TEXT NOT NULL DEFAULT 'git' + ck_git_sources_kind (kind IN ('git','local')); git_sources.path TEXT NULL + uq_git_sources_path (mirrors 0006's uq_git_sources_url). Existing rows read kind='git', path=NULL. API (phase-35 contract extended, git byte-identical): POST kind=local requires path — trimmed, ~-expanded, absolute + an existing server directory, else 422 naming the path (fail loud at add-time); duplicate path 409 (named); wrong field combos 422. GET rows carry kind + path (git and env rows: path null); anonymous still 403 on every route (A10). Sync + import_docs resolve DB git + local rows together: git → clone_or_pull (unchanged); local → re-verified .is_dir() AT SYNC TIME (it may have moved/deleted since add-time) — a missing dir raises "local source missing: <path>" (sanitized) before anything imports; one import_sources(..., prune=True) over the single combined list (pruning covers the union). Both-empty fails loudly ("no sources configured (git or local)"); --source still wins; the env fallback stays git-only. Page: second "Add a local directory" form (the same §7.4 never-stale button + inline-error lifecycle as the git form; 422/409 details name the path), Git/Local badges on rows (text + color, never color alone — WCAG), updated hint (git + local together, union prune); the anonymous sign-in gate is unchanged. Tests: 0007 up/down; the API local-kind matrix (403/201/422/409) with the git-kind suite green unchanged; the sync pipeline local/git/ mixed/missing against a host temp dir (the KB actually updated); import_docs DB resolution + --source precedence. Story E2E (isolated, deterministic across runs): add (Local badge) → missing path inline 422 naming it / duplicate 409 → the real Sync button imports the fixture file (GET /api/docs + sentinel in its content) → file deleted + sync prunes it (union prune) → row removed; anonymous gate + 403s (phase-35 regression). test_git_sources_admin.py (phase 35) green UNCHANGED — no selector collision with the new form; test_sync_button.py green. Docs: README — the two managed kinds (git = clone/pull mirror; local = direct in-place walk), add-time validation, union pruning, "the DB is the local-source registry (no env var for local paths)"; .env.example — the env fallback is git-only.	2026-08-27 01:04:16 -04:00
ducoterra	15c1272828	feat(rag): agent document tools — list/read tools with env-tuned budgets, SSE tool events + "calling tool" UI Grounded chat turns now run the agent loop (app/rag/agent.py) instead of a bare chat_stream: while the per-turn budgets last (BOR_AGENT_LIST_CALLS / BOR_AGENT_READ_CALLS, default 1 each) the model gets list_documents (the indexed catalog, /api/docs order) and read_document (full text, never truncated — A7-revised contract); once both budgets are spent the tools key is dropped from the request and the model must answer. Rejected calls (unknown tool, unknown/missing path, document already in context, spent budget) consume no budget. Budgets 0/0 make exactly one tools=None request — byte-identical to the pre-phase path (budgets-as-kill-switch). Deflected turns keep the direct chat_stream (A8 unchanged; the LOW prompt never carries the <tools> section). SSE contract gains {"type":"tool","name":...,"argument": "source/path"\|null} frames ahead of the answer deltas (PLAN §4 extension, owner permission 2026-08-26); done.sources, query_log.sources and the per-turn log line (gains tool_calls=N) report the retrieval docs + read docs, deduped. The UI shows a "calling tool" button/label state and one visible .tool-call line per call above the answer; the lines persist with the chat record and re-render on reload. chat_stream passes tools through and accumulates streaming tool_calls deltas into ToolCallPiece (tools=None stays byte-identical). E2E: deterministic mock tool flow ("use your tools" + <tools> marker: list -> read first catalog line -> quoted answer) plus the story suite (marker flow, reload re-render, plain/deflected no-tool regressions). Docs: .env.example + README (the two tools, the budgets, the SSE tool frame, the "calling tool" UI state). probe: turbo tool_calls=supported 2026-08-26 (uv run python -m scripts.llm_probe --tools — non-streaming + streaming finish_reason=tool_calls, indexed delta.tool_calls partials)	2026-08-26 22:39:14 -04:00
ducoterra	9efffcb428	feat(viewer): show document summary together with the original (TODO.md L5)	2026-08-26 19:11:15 -04:00
ducoterra	1925bb66a8	feat(sources): admin page to add and remove git sources (TODO.md L4)	2026-08-26 18:42:28 -04:00

1 2