An existing, non-git directory is now a first-class source alongside
the git repos: one table (git_sources + kind discriminator — A13
reversible migration), one admin page, one Sync button (phase locked
decisions; the phase-35 table is extended, not duplicated). The DB is
the local-source registry — no env var for local paths;
BOR_GIT_SOURCES stays a git-only empty-table fallback.
Migration 0007 (reversible, up/down integration-tested):
git_sources.kind TEXT NOT NULL DEFAULT 'git' + ck_git_sources_kind
(kind IN ('git','local')); git_sources.path TEXT NULL +
uq_git_sources_path (mirrors 0006's uq_git_sources_url). Existing rows
read kind='git', path=NULL.
API (phase-35 contract extended, git byte-identical): POST kind=local
requires path — trimmed, ~-expanded, absolute + an existing server
directory, else 422 naming the path (fail loud at add-time); duplicate
path 409 (named); wrong field combos 422. GET rows carry kind + path
(git and env rows: path null); anonymous still 403 on every route (A10).
Sync + import_docs resolve DB git + local rows together: git →
clone_or_pull (unchanged); local → re-verified .is_dir() AT SYNC TIME
(it may have moved/deleted since add-time) — a missing dir raises
"local source missing: <path>" (sanitized) before anything imports;
one import_sources(..., prune=True) over the single combined list
(pruning covers the union). Both-empty fails loudly ("no sources
configured (git or local)"); --source still wins; the env fallback
stays git-only.
Page: second "Add a local directory" form (the same §7.4 never-stale
button + inline-error lifecycle as the git form; 422/409 details name
the path), Git/Local badges on rows (text + color, never color alone —
WCAG), updated hint (git + local together, union prune); the
anonymous sign-in gate is unchanged.
Tests: 0007 up/down; the API local-kind matrix (403/201/422/409) with
the git-kind suite green unchanged; the sync pipeline local/git/
mixed/missing against a host temp dir (the KB actually updated);
import_docs DB resolution + --source precedence. Story E2E (isolated,
deterministic across runs): add (Local badge) → missing path inline
422 naming it / duplicate 409 → the real Sync button imports the
fixture file (GET /api/docs + sentinel in its content) → file deleted
+ sync prunes it (union prune) → row removed; anonymous gate + 403s
(phase-35 regression). test_git_sources_admin.py (phase 35) green
UNCHANGED — no selector collision with the new form;
test_sync_button.py green.
Docs: README — the two managed kinds (git = clone/pull mirror; local =
direct in-place walk), add-time validation, union pruning, "the DB is
the local-source registry (no env var for local paths)";
.env.example — the env fallback is git-only.
385 lines
16 KiB
JavaScript
385 lines
16 KiB
JavaScript
/* Brain of Reese — Git sources admin page (phase 35, task 04;
|
|
* local directories, phase 38 task 04).
|
|
*
|
|
* The page module for /git-sources.html: the admin-only manager for the
|
|
* stored source list (git-sources table, phase 35 tasks 01/02) — git
|
|
* repo URLs (kind "git") and existing local directories (kind
|
|
* "local", phase 38).
|
|
* This module is the single owner of the page's behaviour:
|
|
*
|
|
* • boot — initSharedHeader() (one cached whoami, shared with the
|
|
* header toggling): anonymous → the sign-in gate shows and the
|
|
* manager stays hidden (the exact Sources page gate pattern, and
|
|
* NO /api/git-sources call is made); admin → gate hidden,
|
|
* #git-sources-content revealed, loadSources().
|
|
* • loadSources() — GET /api/git-sources → the table rows
|
|
* (#git-sources-tbody), the env-fallback note's visibility
|
|
* (from_env), and the empty state. Each row leads with its kind
|
|
* badge (Git/Local — text + color, never color alone) plus the
|
|
* location in a mono <code>: the git URL, or the full local path
|
|
* for kind "local" rows (phase 38). Values are ALWAYS rendered
|
|
* with textContent — never innerHTML (URLs may embed user:pass@
|
|
* credentials; phase 32's masking discipline). Non-2xx or a
|
|
* network failure renders the role="alert" load error with a
|
|
* retry button — never a stuck page.
|
|
* • add — #git-source-form submit → POST /api/git-sources {url};
|
|
* #local-source-form submit → POST /api/git-sources
|
|
* {kind: "local", path} (phase 38). ONE §7.4 never-stale
|
|
* lifecycle for both (wireAddForm): the button disables +
|
|
* relabels "Adding…" while the request is out, re-enables on
|
|
* success AND failure. 201 clears the input, reloads the list,
|
|
* and focuses the new row's Remove button (a11y); a failure (409
|
|
* duplicate, 422 validation) shows the server detail inline under
|
|
* the form (role="alert", 422 shape-aware like the tuning forms)
|
|
* and keeps the input — the instruction survives. Local 422/409
|
|
* details name the path (paths are not secrets, unlike URLs).
|
|
* • remove — a row's Remove button asks window.confirm first
|
|
* (removal prunes the documents only on the NEXT sync — the
|
|
* confirm says so). Cancel → nothing; ok → the row button
|
|
* disables, DELETE /api/git-sources/{id}, loadSources(). A
|
|
* failure shows a per-row role="alert" error and re-enables the
|
|
* button. Env-fallback rows (id null — the list comes from
|
|
* BOR_GIT_SOURCES, not the table) carry no Remove: nothing is
|
|
* stored to remove — they show a "from .env" tag instead.
|
|
* • announce(msg) — #git-sources-announcer (role=status,
|
|
* aria-live=polite): the screen-reader confirmation for loads,
|
|
* adds, and removals.
|
|
*
|
|
* Scope boundary (phase locked decisions): adding or removing a repo
|
|
* does NOT clone, import, or prune — the header's Sync sources button
|
|
* (module-owned in assets/header.js) performs that; the page's hint
|
|
* box says so.
|
|
*
|
|
* The shared header module loads through this script's own relative
|
|
* import ("./header.js") — a hoisted import evaluated before this body
|
|
* runs (single-evaluation design: no direct <script> tag; esbuild
|
|
* inlines it into the page bundle in the image build).
|
|
*/
|
|
|
|
import { initSharedHeader } from "./header.js";
|
|
|
|
/* ---------- page elements (git-sources.html, task 04) ---------- */
|
|
const gateEl = document.querySelector("#git-sources-gate");
|
|
const contentEl = document.querySelector("#git-sources-content");
|
|
const formEl = document.querySelector("#git-source-form");
|
|
const urlInput = document.querySelector("#git-source-url");
|
|
const addBtn = document.querySelector("#git-source-add");
|
|
const addError = document.querySelector("#git-source-error");
|
|
/* Phase 38: the second add form — "Local directory" (same element
|
|
contract as the git form, own ids). */
|
|
const localFormEl = document.querySelector("#local-source-form");
|
|
const pathInput = document.querySelector("#local-source-path");
|
|
const localAddBtn = document.querySelector("#local-source-add");
|
|
const localAddError = document.querySelector("#local-source-error");
|
|
const loadErrorEl = document.querySelector("#git-sources-load-error");
|
|
const loadErrorText = document.querySelector("#git-sources-load-error-text");
|
|
const retryBtn = document.querySelector("#git-sources-retry");
|
|
const tableWrap = document.querySelector("#git-sources-table-wrap");
|
|
const tbody = document.querySelector("#git-sources-tbody");
|
|
const emptyEl = document.querySelector("#git-sources-empty");
|
|
const envNote = document.querySelector("#git-sources-env-note");
|
|
const announcer = document.querySelector("#git-sources-announcer");
|
|
|
|
/* Polite live region: the screen-reader confirmation for loads, adds,
|
|
and removals (the phase-15 announcer pattern). */
|
|
function announce(message) {
|
|
if (announcer) announcer.textContent = message;
|
|
}
|
|
|
|
/* Added date — localized (toLocaleString); env-fallback rows carry
|
|
added_at null, and a corrupt timestamp must not blank the cell. */
|
|
function fmtDate(iso) {
|
|
if (!iso) return "—";
|
|
try {
|
|
return new Date(iso).toLocaleString();
|
|
} catch {
|
|
return "—";
|
|
}
|
|
}
|
|
|
|
/* FastAPI error bodies: a string detail or the validation-error array
|
|
(the first entry's msg is the human line). Same extraction as
|
|
tuning.js — 422 shape-aware. */
|
|
async function apiDetail(r, fallback) {
|
|
try {
|
|
const data = await r.json();
|
|
if (Array.isArray(data.detail) && data.detail[0] && data.detail[0].msg) {
|
|
return String(data.detail[0].msg);
|
|
}
|
|
if (typeof data.detail === "string" && data.detail) return data.detail;
|
|
} catch {
|
|
/* non-JSON error body */
|
|
}
|
|
return fallback;
|
|
}
|
|
|
|
/* ---------- load / render ---------- */
|
|
|
|
/* GET /api/git-sources → the table rows + env note + empty state.
|
|
The load error (role="alert" + retry) is the ONLY terminal state a
|
|
failed fetch may reach — never a stuck page. */
|
|
async function loadSources() {
|
|
let r;
|
|
try {
|
|
r = await fetch("/api/git-sources");
|
|
} catch {
|
|
showLoadError("Could not reach the server — is the app running?");
|
|
return;
|
|
}
|
|
if (!r.ok) {
|
|
showLoadError(await apiDetail(r, `The server could not list the git sources (${r.status}).`));
|
|
return;
|
|
}
|
|
let data;
|
|
try {
|
|
data = await r.json();
|
|
} catch {
|
|
showLoadError("The server sent an unreadable list — try again.");
|
|
return;
|
|
}
|
|
hideLoadError();
|
|
const sources = Array.isArray(data.sources) ? data.sources : [];
|
|
renderSources(sources, data.from_env === true);
|
|
announce(`${sources.length} source${sources.length === 1 ? "" : "s"} listed.`);
|
|
}
|
|
|
|
function showLoadError(message) {
|
|
if (loadErrorText) loadErrorText.textContent = message;
|
|
if (loadErrorEl) loadErrorEl.hidden = false;
|
|
// The list state is unknown — hide the table AND the empty state so
|
|
// the error is the only claim about the list's contents.
|
|
if (tableWrap) tableWrap.hidden = true;
|
|
if (emptyEl) emptyEl.hidden = true;
|
|
}
|
|
|
|
function hideLoadError() {
|
|
if (loadErrorEl) loadErrorEl.hidden = true;
|
|
if (loadErrorText) loadErrorText.textContent = "";
|
|
}
|
|
|
|
function renderSources(sources, fromEnv) {
|
|
if (envNote) envNote.hidden = !fromEnv;
|
|
if (tbody) {
|
|
tbody.replaceChildren();
|
|
for (const s of sources) tbody.appendChild(makeRow(s));
|
|
}
|
|
const hasRows = sources.length > 0;
|
|
if (tableWrap) tableWrap.hidden = !hasRows;
|
|
if (emptyEl) emptyEl.hidden = hasRows;
|
|
}
|
|
|
|
/* One row: the kind badge (Git/Local — phase 38) followed by the
|
|
location in a mono <code> (textContent only — git URLs may contain
|
|
credentials, local paths may contain anything), the localized added
|
|
date ("—" for env fallback rows), and the per-row Remove button —
|
|
or the "from .env" tag for env-fallback rows (id null: nothing is
|
|
stored to remove; the env note says where the active list comes
|
|
from). The value is the git URL for kind "git" rows and the full
|
|
local path for kind "local" rows (the API reports the path in both
|
|
`path` and `url`; `path` is the kind-typed field). */
|
|
const REMOVE_ICON =
|
|
'<svg aria-hidden="true" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="1.8" stroke-linecap="round"><path d="M5 7h14M10 7V5h4v2M8.5 7l.7 12h5.6l.7-12"/></svg>';
|
|
|
|
function makeRow(s) {
|
|
const tr = document.createElement("tr");
|
|
if (s.id) tr.dataset.id = s.id;
|
|
|
|
const isLocal = s.kind === "local";
|
|
const value = isLocal ? (s.path ?? s.url) : s.url;
|
|
const kindLabel = isLocal ? "local" : "git";
|
|
|
|
const urlTd = document.createElement("td");
|
|
urlTd.className = "git-source-url-cell";
|
|
urlTd.title = value; // full URL/path on hover (long values scroll the wrapper)
|
|
const badge = document.createElement("span");
|
|
badge.className = `git-source-kind is-${isLocal ? "local" : "git"}`;
|
|
badge.textContent = isLocal ? "Local" : "Git"; // text + color, never color alone
|
|
const code = document.createElement("code");
|
|
code.textContent = value; // rendered as text, never as HTML
|
|
urlTd.append(badge, code);
|
|
tr.appendChild(urlTd);
|
|
|
|
const addedTd = document.createElement("td");
|
|
addedTd.textContent = fmtDate(s.added_at);
|
|
tr.appendChild(addedTd);
|
|
|
|
const actTd = document.createElement("td");
|
|
actTd.className = "git-source-actions-cell";
|
|
if (s.id) {
|
|
const btn = document.createElement("button");
|
|
btn.type = "button";
|
|
btn.className = "git-source-remove";
|
|
btn.setAttribute("aria-label", `Remove ${kindLabel} source: ${value}`);
|
|
btn.innerHTML = REMOVE_ICON + "<span>Remove</span>";
|
|
const rowError = document.createElement("span");
|
|
rowError.className = "git-source-row-error";
|
|
rowError.setAttribute("role", "alert");
|
|
rowError.hidden = true;
|
|
btn.addEventListener("click", () => removeSource(s, btn, rowError, kindLabel));
|
|
actTd.append(btn, rowError);
|
|
} else {
|
|
const tag = document.createElement("span");
|
|
tag.className = "git-source-env-tag";
|
|
tag.textContent = "from .env";
|
|
actTd.appendChild(tag);
|
|
}
|
|
tr.appendChild(actTd);
|
|
return tr;
|
|
}
|
|
|
|
/* ---------- remove (DELETE /api/git-sources/{id}) ----------
|
|
* Removal does not prune anything immediately — the next sync does
|
|
* (phase scope boundary), so the confirm says exactly that. Cancel →
|
|
* nothing; a failed delete → per-row role="alert" error + re-enabled
|
|
* button (never a stuck row); success → the list reloads. */
|
|
async function removeSource(s, btn, rowError, kindLabel) {
|
|
const ok = window.confirm(
|
|
`Remove this ${kindLabel} source from the list? Its documents stay indexed until the next sync prunes them.`,
|
|
);
|
|
if (!ok) return;
|
|
btn.disabled = true; // one delete per click
|
|
rowError.hidden = true;
|
|
try {
|
|
const r = await fetch(`/api/git-sources/${encodeURIComponent(s.id)}`, { method: "DELETE" });
|
|
if (!r.ok) {
|
|
rowError.textContent = await apiDetail(r, `Could not remove the ${kindLabel} source — try again.`);
|
|
rowError.hidden = false;
|
|
btn.disabled = false;
|
|
return;
|
|
}
|
|
announce("Source removed.");
|
|
await loadSources(); // 204: the server confirmed — the list re-renders
|
|
} catch {
|
|
rowError.textContent = `Could not remove the ${kindLabel} source — is the app reachable?`;
|
|
rowError.hidden = false;
|
|
btn.disabled = false;
|
|
}
|
|
}
|
|
|
|
/* ---------- add (POST /api/git-sources) — both forms, one lifecycle
|
|
* (the local form is phase 38) ----------
|
|
* The git form posts {url}; the local form posts {kind:"local",path}.
|
|
* wireAddForm gives both the §7.4 never-stale lifecycle: while the
|
|
* request is out the button disables + relabels "Adding…" and
|
|
* re-enables (idle label restored) on success AND failure. 201 clears
|
|
* the input, reloads the list, and focuses the new row's Remove button
|
|
* (a11y); a failure (409 duplicate, 422 validation) shows the server
|
|
* detail inline under the form (role="alert", 422 shape-aware via
|
|
* apiDetail) and keeps the input — the fix is one edit, not a re-type.
|
|
* Git 409/422 details are fixed generic strings (credential safety);
|
|
* local details name the path (not a secret). */
|
|
function wireAddForm(opts) {
|
|
const { form, input, btn, error } = opts;
|
|
if (!form || !input || !btn) return;
|
|
form.addEventListener("submit", async (e) => {
|
|
e.preventDefault();
|
|
// Client-side non-empty check (the input is `required` too — the
|
|
// browser's native prompt is the first line, this one the second).
|
|
const value = input.value.trim();
|
|
if (!value) {
|
|
if (error) {
|
|
error.textContent = opts.emptyMessage;
|
|
error.hidden = false;
|
|
}
|
|
return;
|
|
}
|
|
if (error) error.hidden = true; // a new attempt starts clean
|
|
btn.disabled = true; // §7.4: one POST per click
|
|
btn.textContent = "Adding…";
|
|
try {
|
|
const r = await fetch("/api/git-sources", {
|
|
method: "POST",
|
|
headers: { "Content-Type": "application/json" },
|
|
body: JSON.stringify(opts.body(value)),
|
|
});
|
|
if (r.ok) {
|
|
let createdId = null;
|
|
try {
|
|
createdId = (await r.json()).id ?? null;
|
|
} catch {
|
|
/* the 201 body is advisory — the reload is the truth */
|
|
}
|
|
input.value = ""; // 201: the source is stored
|
|
announce(opts.addedMessage);
|
|
await loadSources(); // the new row lands in the table
|
|
focusNewRow(createdId); // a11y: land the caret on the new row
|
|
return;
|
|
}
|
|
// 409 duplicate / 422 validation / anything else: the server
|
|
// detail inline, form kept — the input survives so the fix is
|
|
// one edit, not a re-type.
|
|
if (error) {
|
|
error.textContent = await apiDetail(r, opts.failMessage);
|
|
error.hidden = false;
|
|
}
|
|
} catch {
|
|
if (error) {
|
|
error.textContent = opts.networkMessage;
|
|
error.hidden = false;
|
|
}
|
|
} finally {
|
|
btn.disabled = false; // never stale — success OR failure
|
|
btn.textContent = opts.idleLabel;
|
|
}
|
|
});
|
|
}
|
|
|
|
wireAddForm({
|
|
form: formEl,
|
|
input: urlInput,
|
|
btn: addBtn,
|
|
error: addError,
|
|
body: (url) => ({ url }),
|
|
emptyMessage: "Enter a git URL to add.",
|
|
failMessage: "Could not add the git source — try again.",
|
|
networkMessage: "Could not add the git source — is the app reachable?",
|
|
addedMessage: "Git source added.",
|
|
idleLabel: "Add source",
|
|
});
|
|
|
|
wireAddForm({
|
|
form: localFormEl,
|
|
input: pathInput,
|
|
btn: localAddBtn,
|
|
error: localAddError,
|
|
body: (path) => ({ kind: "local", path }),
|
|
emptyMessage: "Enter a directory path to add.",
|
|
failMessage: "Could not add the local directory — try again.",
|
|
networkMessage: "Could not add the local directory — is the app reachable?",
|
|
addedMessage: "Local source added.",
|
|
idleLabel: "Add directory",
|
|
});
|
|
|
|
/* After a successful add, focus the new row's Remove button so the
|
|
keyboard/screen-reader user lands where the new data is. The 201
|
|
body carries the row id (tr[data-id]); without one, the first row
|
|
is the fallback (the list is small and ordered). */
|
|
function focusNewRow(createdId) {
|
|
if (!tbody) return;
|
|
const row = createdId
|
|
? tbody.querySelector(`tr[data-id="${CSS.escape(createdId)}"]`)
|
|
: null;
|
|
const target = (row || tbody.querySelector("tr"))?.querySelector(".git-source-remove");
|
|
if (target) target.focus();
|
|
}
|
|
|
|
/* ---------- retry + boot ---------- */
|
|
|
|
if (retryBtn) retryBtn.addEventListener("click", () => loadSources());
|
|
|
|
(async () => {
|
|
// The shared header FIRST (Sign in/out + the admin-only nav links +
|
|
// the Sync button — one cached whoami), then the gate: anonymous
|
|
// visitors get the gate and NO /api/git-sources call (the Sources
|
|
// page gate pattern); the admin gets the manager.
|
|
const admin = await initSharedHeader();
|
|
if (!admin) {
|
|
if (gateEl) gateEl.hidden = false;
|
|
if (contentEl) contentEl.hidden = true; // ships hidden — stays hidden
|
|
return;
|
|
}
|
|
if (gateEl) gateEl.hidden = true;
|
|
if (contentEl) contentEl.hidden = false;
|
|
await loadSources();
|
|
})();
|