7 Commits

Include renames

Author	SHA1	Message	Date
ducoterra	3b2dea5685	phase: 102_extensionless_filenames ... All verification complete — every gate green, no defects found in previously completed work. **Phase 102 final verification pass — report** Verified (all three task files present in `complete/`; working-tree implementation matches D1–D5 design): - `match_extension` choke point in `app/rag/importer.py` (walk + `formats` counter), `doc_format` name-token badge in `app/api/docs.py`, config/`.env.example` docs, fixture `tests/fixtures/extensionless_kb/`, integration + E2E suites — all present and correct - Completion criteria: end-to-end sync (✓ integration + E2E), case matrix incl. `mydockerfile`/`Dockerfile.dev`/`.dockerfile` exclusions (✓ unit), `formats=dockerfile:1` not `unknown` (✓ log-line assertion), badge `dockerfile`/`containerfile` + `text` fallback + suffixed unchanged (✓ unit/integration/E2E), prune-on-token-removal (✓ `pruned==2`), suffixed-path rule byte-identical (✓ single-line swap, existing cases untouched) Test / lint results (exact commands): - `uv run pytest --cov=app --cov-report=term-missing` → 2084 passed, **99%** coverage (>90% gate) - `uv run pytest tests/e2e/test_extensionless_import.py -v --no-cov` → 2 passed, isolated, DB up - Regressions isolated: `test_import_documents` 3✓, `test_import_extensions_env` 2✓, `test_quadlet_jinja_import` 4✓, `test_document_viewer` 7✓, `test_kb_tree` 8✓ - `uv run ruff check .` → clean; `uv run pyright` → 0 errors, 0 warnings Notable: commit intentionally not made (harness commits the phase); 102's task files already sit in `complete/`, overview stays in `todo/` for the harness. Next pending phases: 98, 99, 103, 104, 105 (numeric next after 102: `103_suggestions_session_openers`).	2026-09-12 15:56:43 -04:00
ducoterra	8c706259e9	phase: 89_source_ignore_paths ... All verification complete — TODO.md was already cleared in the roadmap commit; the two extra unit-test diffs are necessary fake-signature adaptations for the new keywords. Everything is green, no fixes were needed. ## Phase 89 — final verification pass: ALL GREEN **Verified (all 6 task files present in `complete/`):** - `git_sources.ignore_paths` JSONB column + migration 0013; `alembic downgrade -1 && upgrade head` round-trips (head `0013`) - Importer: `normalize_ignore_path`/`is_ignored`/`_ignore_for_root`, `ignore` in walk + progress pre-walk, `ignore_by_root` in `import_sources` - API: GET/POST carry list; admin-only `PATCH` (replace, 404/422 fixed details, anonymous 403) - Pipelines wired: `_run_sync`, `_run_upload` re-upload, `scripts/import_docs.py` - Sources-page box: dialog, §7.4 save lifecycle, `N ignored` tag, a11y; env rows get no box **Test/lint results:** - `uv run pytest` → 1808 passed - `uv run pytest --cov=app --cov-report=term-missing` → TOTAL **99%** (>90%) - `uv run pytest tests/e2e/test_source_ignore_paths.py -v --no-cov` → 6 passed (isolated, DB up) - Regressions in isolation: `test_git_sources_admin` 6, `test_archive_upload_sources` 5, `test_sync_button` 3, `test_smoke` 3 — all passed - `uv run ruff check . && uv run pyright` → clean (0 errors) **Completion criteria:** box→PATCH 200→count+GET round-trip ✅ · sync excludes `ignore/` (no docs/chunks/embeddings/summaries) + prunes newly-ignored (pruned==2) ✅ · no-mid-path rule E2E ✅ · PATCH 404/422/replace/clear/403 ✅ · full gate green ✅ · commit + phase move left to harness per rules. **Deviations:** none blocking — E2E pins `files == 4` (overview's "5" was an off-by-one vs its own 6-file tree, documented in-test); `tests/unit/test_importer.py` + `test_sync_button.py` test-double fakes extended for the new keywords (needed for the suite to stay green). **Next pending phase:** none — `todo/` holds only this phase.	2026-09-09 01:45:42 -04:00
ducoterra	4677d86f49	feat(sources): real-time file progress for sync and upload — background upload with success toast	2026-09-01 23:51:43 -04:00
ducoterra	d94f3d5a52	feat(import): user-extensible BOR_IMPORT_EXTENSIONS — any well-formed extension, A9 family stays the default	2026-08-31 22:42:41 -04:00
ducoterra	572a4190a6	feat(rag): lite-model document summaries — non-markdown docs summarized at import, summary chunk retrieves and resolves to the full source doc	2026-08-25 17:48:37 -04:00
ducoterra	7e8d14702e	feat(rag): hybrid FTS+vector retrieval and multi-format ingestion — name-your-tool questions find the right document	2026-08-22 01:27:02 -04:00
ducoterra	99c48cbe06	feat(rag): index markdown KB — chunker, embed client, delta importer, Sources page ... Phase 02 (story: import documents): - fence-aware markdown chunker (heading sections, 200-char overlap, heading anchor on every chunk, 1200-char hard cap, fence blocks kept atomic and split under the cap) - LLMClient over aipi (LiteLLM) reusing the openai client's httpx transport to send a clean {model, input} payload — the openai SDK injects encoding_format, which aipi's openai_like group rejects; token-budget batching + halving retry for the endpoint's ~1024-token per-request input cap - two-phase per-file upsert importer: sha256 delta (unchanged skip), atomic commit, A9 exclusion walk, per-source prune, per-file error tolerance (rollback + log + continue, non-zero CLI exit), adaptive re-chunk at half target for URL-dense files the endpoint rejects - scripts/import_docs CLI (repeatable --source, --prune, --limit, defaults ~/Homelab + ~/Deployments) - GET /api/docs with per-doc chunk counts; Sources page wired to the real endpoint (stat cards, full-width a11y table, designed empty state, DOM-built rows — no innerHTML) - tests: 63 passed (chunker/llm/importer units, docs API + importer integration), story E2E 3/3 (real endpoints, in-thread import); app/ coverage 98% - real KB imported: 672 docs / 8969 chunks in ~3m, idempotent re-run (672 unchanged, 0 batches) - harness: .agent/validate.sh now gates through uv (pytest + coverage >90% + ruff + pyright) instead of system python3	2026-08-21 16:24:45 -04:00