From bd2315cf4c45455ea69578ff0f1279c27de271c2 Mon Sep 17 00:00:00 2001 From: tegwick Date: Sun, 17 May 2026 19:21:57 +0200 Subject: [PATCH] chore(consistency): sync task status from DB [auto] Updated by fix-consistency on 2026-05-17: - update .custodian-brief.md for llm-connect --- .custodian-brief.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/.custodian-brief.md b/.custodian-brief.md index b060d98..9c5ddd2 100644 --- a/.custodian-brief.md +++ b/.custodian-brief.md @@ -2,23 +2,23 @@ # Custodian Brief — llm-connect **Domain:** custodian -**Last synced:** 2026-05-17 16:47 UTC +**Last synced:** 2026-05-17 17:21 UTC **State Hub:** http://127.0.0.1:8000 *(adjust if running on a remote machine)* ## Active Workstreams ### Adaptive Cost-Quality Routing -Progress: 0/23 done | workstream_id: `e1807fab-e29e-4517-b362-95737a96582d` +Progress: 5/23 done | workstream_id: `e1807fab-e29e-4517-b362-95737a96582d` **Open tasks:** -- · QualityObservation dataclass: task_type, adapter_id, model_id, cost_usd, quality_score (0..1), latency_ms, tokens_in, tokens_out, baseline_adapter_id, recorded_at, tags `1c285bec` -- · QualityLedger append-only JSONL store with file-locked writes, configurable path, simple query helpers (by_task_type, recent, mean_quality) `5249f171` -- · TTL helpers: prune_before(timestamp) and is_stale(observation, max_age) `adb255cf` -- · Functional contract doc for the ledger schema and quality_score semantics `51a33180` -- · Tests: ledger round-trip, concurrent writes, query helpers, TTL, malformed-line resilience `458610c5` - · GradingResult dataclass: quality_score, notes, grader_id, baseline_response, candidate_response `c12a595b` - · BaselineGrader protocol plus PairedGrader that runs baseline and candidate calls and delegates to a Judge `80b98e31` -- … and 16 more open tasks +- · Judge protocol and built-ins: ExactMatchJudge, EmbeddingSimilarityJudge, LLMJudge `c2887fe3` +- · Functional contract doc covering judge bias caveats `7a4fd87a` +- · Tests: judges with canned inputs, stable grader result, deterministic LLMJudge rubric seed `8415a11d` +- · AdaptiveRoutingPolicy extends RoutingPolicy and selects the cheapest adapter whose observed mean quality clears the floor `0e9f9f8e` +- · Tie-breaking: prefer lower observed cost, then explicit preferred adapter from static rules `59d44712` +- … and 11 more open tasks --- ## MCP Orientation (when available)