7 Commits

Include renames

Author	SHA1	Message	Date
RaymondVerhoef	ca8945ea5b	refactor: remove handbook sync state and related functionality	2026-05-22 19:45:14 +02:00
RaymondVerhoefandClaude Opus 4.7	229246f7b6	feat: phase 5 of AI pipeline hardening — R42 retrieval & telemetry ... - Add dependency-free TF-IDF retrieval (src/lib/retrieval.js) with NL+EN stopwords and a WeakMap-cached index. - Rewrite buildKbContext to ship the top-K relevant topics + verbatim- mentioned ids only, filter relations to the included set, and append a [kb_hash: <8 hex>] suffix so the ephemeral prompt cache busts when the graph changes. Returns { context, retrievedTopics, allTopics }. - Add LOOKUP_TOPIC_TOOL and drive useChat through callLLM directly with a multi-hop tool_result loop capped at 3 hops; preserve Anthropic-provided tool_use ids through callLLM so the loop can echo correct tool_use_id. - Truncate R42 history to the last 12 turns and prepend a single "(earlier conversation truncated)" assistant message. - Set R42 chat defaults: temperature 0.3, maxTokens 2048. - Add pb_migrations/1780500002_created_llm_calls.js (the best-effort logger in callLLM was already wired) and a new Admin → Diagnostics view showing the last 100 calls with token usage, cache-hit rate, and USD cost from a local Anthropic price table. - Finalize AI_PIPELINE_HARDENING_PLAN.md: mark Phases 1–5 shipped and Phase 6 (eval harness) explicitly out of scope. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-05-20 21:36:40 +02:00
RaymondVerhoefandClaude Opus 4.7	aeb197d5f4	feat: phase 3 of AI pipeline hardening — extraction quality ... Replace stateless one-shot extraction with a stateful, paced, cancellable pipeline. Six subtasks: - 3.1 Sentence-aware chunking with 800-char overlap (was paragraph-only at 4000 chars). Hard-split fallback for runaway sentences. - 3.2 Stateful extraction: chunks 2+ receive an "already-extracted topic IDs" hint capped at 200 IDs, so the model reuses IDs instead of inventing variants like software-developer vs software-engineer. - 3.3 Token-bucket limiter in llmRetry.js (extractionLimiter, 5 req/min). callLLM awaits the limiter before fetch; 429+Retry-After calls pauseUntil. Replaces hard setTimeout(12000) and setTimeout(15000). - 3.4 relevance_locked column on topics — admin edits to relevance are sticky across re-extraction. Migration + merge respects the flag + unlock checkbox in KnowledgeGraph edit form. - 3.5 Unify relation vocabulary — handbook prompt no longer mentions legacy "executes"; one-shot migration rewrites existing executes rows to executed_by with source/target swapped. - 3.6 Cancellation — Cancel button on UploadZone wired to an AbortController threaded into callLLM; aborted runs persist status = "cancelled" rather than "failed". Tests: 16 new unit tests for chunkText, buildKnownIdsHint, and createLimiter. All 61 tests pass, 0 lint errors, build clean. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-05-20 17:56:45 +02:00
RaymondVerhoef	d23b0b6b16	feat: add learning_relevance field to topics and implement KnowledgeGraph UI with handbook synchronization capabilities	2026-05-19 08:40:52 +02:00
RaymondVerhoef	f35550f270	feat: add knowledge graph component and persistent handbook sync state collection	2026-05-18 21:13:17 +02:00
RaymondVerhoef	07a41938f1	feat: add created and updated autodate fields to sources collection via migration	2026-05-18 20:35:03 +02:00
RaymondVerhoef	3afef7785e	feat: perform extensive database collection migrations and updates to PocketBase schema	2026-05-18 20:12:40 +02:00