**Phase 188 — final verification pass: all criteria green.** - **Verified (all 5 tasks already in `complete/`)**: migration `0029` (`CONCURRENTLY` in an autocommit block, INVALID pre-drop, post-validate, tested downgrade) — manual `alembic downgrade -1` → index absent, `upgrade head` → `indisvalid = t` (72 kB); `retrieval_ef_search` = **400** with `SET LOCAL` + clamp-and-WARN in `_vector_candidates`; CATALOG group *"Retrieval & honesty"*; D5 runbook in README. - `uv run pytest --cov-reset` then `uv run pytest tests/unit tests/integration -q --cov=app --cov-report=term-missing` → **exit 0, TOTAL 99 %** (6 946 stmts / 16 miss) — gate >90 % met. (A stale `.coverage` left by an earlier session produced a spurious 90.00 %/3-failure reading; `--cov-reset` cleared it.) - `uv run pytest tests/e2e/test_vector_index_recall.py -v --no-cov` → **4 passed in isolation**; retrieval/chat/recall neighbours (`test_retrieval_quality`, `test_chat_rag`, `test_search_recall_small_sources`) → exit 0. - `uv run ruff check .` → **All checks passed**; `uv run pyright` (whole repo) → **0 errors**. - **Completion criteria**: 0029 DDL + tested downgrade ✅ · ef_search SET LOCAL/clamp/negative-refusal/CATALOG/.env.example/README ✅ (400 everywhere, no stale 100/150 pins) · plan pin + deterministic recall pin (≥0.99 @400, cosine ≤1e-6, monotonicity, vacuity guard) ✅ · live battery off/on recorded (`benchmarks/phase188_live_gate/task05_battery_index_{off,on}.txt` byte-identical, `deterministic_gate_recall.txt`, build 161 s / 1 625 MB / 81 MB RSS, phase report `.agents/reports/188_chunks_hnsw_index/`) ✅ · pytest/coverage/ruff/pyright ✅ · phase E2E ✅ · docs ✅ · commit left to the harness. - **Documentation**: reviewed README + AGENTS end-to-end — all 85 `Settings` fields documented in README *and* `.env.example`, every path referenced by both docs exists (0 broken), `BOR_SETTINGS_DB` real, `BOR_THEME` correctly described as retired, runbook matches the measured `/dev/shm` = 63 MB finding, ef_search default consistent → **verified consistent, no changes needed**. - **Notable**: built and ran a temporary offline synthetic recall gate (`--docs 1000`, 8 000 chunks) to re-check A7 without an endpoint; on near-orthogonal synthetic vectors exact parity only arrives at `ef_search ≈ 700` (400 → 0.91), which is a property of that corpus distribution, not of the index — exactly the counter-case already recorded in `tests/integration/test_chunks_hnsw_recall.py`. Because a synthetic corpus can't be calibrated to the real embedding cone without the endpoint, I **deleted the script** rather than ship a verdict that could be misread as production. `AIPI_KEY` is absent in this environment (and `100.117.2.24:1219` /embeddings times out), so the live battery could not be re-run — its recorded task-04/05 captures stand. Scratch DB `brain_of_reese_hnswgate` dropped; repo left clean. - **Next pending phase**: `189_chat_save_long_turns`.
164 lines
6.6 KiB
Python
164 lines
6.6 KiB
Python
"""Integration: migration 0005 (kb_overview) schema contract.
|
|
|
|
Drives the **real Alembic engine** against the live dev database
|
|
(``podman compose up -d db``), mirroring the style of
|
|
``test_migration_0004.py`` (information_schema assertions on the state the
|
|
migration must leave):
|
|
|
|
The tests target revision ``0005`` explicitly so later migrations
|
|
(0006, …) cannot break them.
|
|
|
|
* upgrade to 0005 → ``kb_overview`` exists with exactly the three columns
|
|
the phase locks in (``id INTEGER PK`` default 1, ``content TEXT NOT NULL``
|
|
default ``''``, ``updated_at TIMESTAMPTZ NOT NULL`` default ``now()``),
|
|
and a bare insert lands the single-row defaults (id=1, content='');
|
|
* downgrade to 0004 → the table is gone;
|
|
* upgrade to 0005 again → it is back (round-trip).
|
|
|
|
The ``alembic`` fixture guarantees the DB ends at head even if a test
|
|
fails or the process is interrupted.
|
|
"""
|
|
from __future__ import annotations
|
|
|
|
from collections.abc import Iterator
|
|
from typing import Any
|
|
|
|
import pytest
|
|
from alembic.config import Config
|
|
from sqlalchemy import text
|
|
from sqlalchemy.orm import Session
|
|
|
|
from alembic import command
|
|
from app.db import db_available
|
|
|
|
|
|
@pytest.fixture()
|
|
def alembic(db: Session) -> Iterator[Config]:
|
|
"""Real Alembic config bound to the dev DB (URL from app settings).
|
|
|
|
Starts at head (repairs an interrupted earlier run); teardown upgrades
|
|
to head no matter what happened, so the dev DB is never left below
|
|
head.
|
|
"""
|
|
if not db_available():
|
|
pytest.skip("Postgres not reachable — run `podman compose up -d db` first")
|
|
cfg = Config() # no alembic.ini file — env.py gets the URL from app config
|
|
cfg.set_main_option("script_location", "alembic")
|
|
command.upgrade(cfg, "head")
|
|
try:
|
|
yield cfg
|
|
finally:
|
|
# Release the test session's open transaction BEFORE the repair
|
|
# DDL: psycopg3 keeps its snapshot alive while idle-in-transaction,
|
|
# and 0029's CREATE INDEX CONCURRENTLY phase 3 waits for every
|
|
# older-snapshot transaction — an unreleased session would park
|
|
# the build forever.
|
|
db.rollback()
|
|
command.upgrade(cfg, "head")
|
|
|
|
|
|
def _column(db: Session, column: str) -> tuple[Any, ...] | None:
|
|
"""(data_type, is_nullable, column_default) for one kb_overview column."""
|
|
row = db.execute(
|
|
text(
|
|
"SELECT data_type, is_nullable, column_default"
|
|
" FROM information_schema.columns"
|
|
" WHERE table_name = 'kb_overview' AND column_name = :c"
|
|
),
|
|
{"c": column},
|
|
).fetchone()
|
|
return tuple(row) if row is not None else None
|
|
|
|
|
|
def _version(db: Session) -> str | None:
|
|
return db.execute(text("SELECT version_num FROM alembic_version")).scalar()
|
|
|
|
|
|
def test_upgrade_to_0005_creates_kb_overview(db: Session, alembic: Config) -> None:
|
|
"""Upgrade 0004 → 0005: the single-row table exists with the locked
|
|
column types, nullability, and server defaults."""
|
|
command.downgrade(alembic, "0004") # start from the pre-0005 state
|
|
assert _version(db) == "0004"
|
|
|
|
command.upgrade(alembic, "0005")
|
|
assert _version(db) == "0005", "alembic_version must be at 0005"
|
|
|
|
pk = db.execute(
|
|
text(
|
|
"SELECT column_name FROM information_schema.table_constraints tc"
|
|
" JOIN information_schema.key_column_usage kcu"
|
|
" ON tc.constraint_name = kcu.constraint_name"
|
|
" WHERE tc.table_name = 'kb_overview' AND tc.constraint_type = 'PRIMARY KEY'"
|
|
)
|
|
).scalar()
|
|
assert pk == "id", "kb_overview primary key must be id"
|
|
|
|
id_col = _column(db, "id")
|
|
assert id_col is not None, "kb_overview.id is missing"
|
|
assert id_col[0] == "integer", "kb_overview.id must be INTEGER"
|
|
assert id_col[1] == "NO", "kb_overview.id must be NOT NULL"
|
|
assert id_col[2] == "1", "kb_overview.id must have server default 1"
|
|
|
|
content = _column(db, "content")
|
|
assert content is not None, "kb_overview.content is missing"
|
|
assert content[0] == "text", "kb_overview.content must be TEXT"
|
|
assert content[1] == "NO", "kb_overview.content must be NOT NULL"
|
|
assert content[2] is not None and "''" in content[2], (
|
|
"kb_overview.content must have server default ''"
|
|
)
|
|
|
|
updated = _column(db, "updated_at")
|
|
assert updated is not None, "kb_overview.updated_at is missing"
|
|
assert updated[0] == "timestamp with time zone", "kb_overview.updated_at must be TIMESTAMPTZ"
|
|
assert updated[1] == "NO", "kb_overview.updated_at must be NOT NULL"
|
|
assert updated[2] is not None and "now()" in updated[2], (
|
|
"kb_overview.updated_at must have server default now()"
|
|
)
|
|
|
|
|
|
def test_bare_insert_gets_single_row_defaults(db: Session, alembic: Config) -> None:
|
|
"""A column-less insert lands the single-row shape the phase relies on:
|
|
``id = 1``, ``content = ''``, server-stamped ``updated_at``."""
|
|
command.upgrade(alembic, "head")
|
|
try:
|
|
db.execute(text("DELETE FROM kb_overview"))
|
|
db.execute(text("INSERT INTO kb_overview DEFAULT VALUES"))
|
|
db.commit()
|
|
row = db.execute(
|
|
text("SELECT id, content, updated_at IS NOT NULL FROM kb_overview")
|
|
).fetchone()
|
|
assert row is not None, "the bare insert must land one row"
|
|
assert row[0] == 1, "kb_overview.id must default to 1"
|
|
assert row[1] == "", "kb_overview.content must default to the empty string"
|
|
assert row[2] is True, "kb_overview.updated_at must be stamped by the server"
|
|
finally:
|
|
db.execute(text("DELETE FROM kb_overview"))
|
|
db.commit()
|
|
|
|
|
|
def test_downgrade_to_0004_drops_table(db: Session, alembic: Config) -> None:
|
|
"""Downgrade to 0004: the table is dropped (A13 — reversible)."""
|
|
command.downgrade(alembic, "0004")
|
|
assert _version(db) == "0004"
|
|
|
|
exists = db.execute(
|
|
text("SELECT to_regclass('public.kb_overview') IS NOT NULL")
|
|
).scalar()
|
|
assert exists is False, "kb_overview must be dropped by the downgrade"
|
|
|
|
|
|
def test_upgrade_round_trip_restores_table(db: Session, alembic: Config) -> None:
|
|
"""Downgrade to 0004, then upgrade back to 0005: table + defaults are
|
|
back (self-contained — does not rely on a prior test's downgrade)."""
|
|
command.downgrade(alembic, "0004")
|
|
command.upgrade(alembic, "0005")
|
|
assert _version(db) == "0005", "round-trip upgrade must land at 0005"
|
|
|
|
id_col = _column(db, "id")
|
|
assert id_col is not None and id_col[2] == "1", "kb_overview.id must be back with default 1"
|
|
|
|
content = _column(db, "content")
|
|
assert content is not None and content[2] is not None and "''" in content[2], (
|
|
"kb_overview.content must keep its '' default after the round-trip"
|
|
)
|