Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

cash_accounts

null

2026-02-23T04:42:13.082523

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly describes a specific banking mechanism - credit lines that allow borrowing and repaying up to a limit without maintaining large cash reserves. It captures a distinct financial instrument rather than a vague concept, though it could be slightly more precise about the mechanics of how limits are determined.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book II, Chapter 2, where he specifically discusses Scottish banking innovations including cash accounts. Smith explicitly describes this system and its effects on merchant operations and capital efficiency.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for cash accounts, as they represent a financial mechanism that facilitates trade and commerce. This banking innovation directly relates to how value and capital are exchanged and circulated in the economy.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Cash accounts map well to S1 (primary operations) as they are operational tools that enable merchants to conduct business more efficiently. They also have some S2 relevance as coordination mechanisms that smooth capital flows and reduce oscillations in merchant liquidity.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating how financial innovations can increase capital efficiency and enable larger-scale commerce. It demonstrates a concrete mechanism by which banking systems can amplify economic activity beyond what would be possible with purely cash-based transactions.

Evaluation: Cash Accounts

definition_precision — 4.0 / 5.0

The definition clearly describes a specific banking mechanism - credit lines that allow borrowing and repaying up to a limit without maintaining large cash reserves. It captures a distinct financial instrument rather than a vague concept, though it could be slightly more precise about the mechanics of how limits are determined.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book II, Chapter 2, where he specifically discusses Scottish banking innovations including cash accounts. Smith explicitly describes this system and its effects on merchant operations and capital efficiency.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for cash accounts, as they represent a financial mechanism that facilitates trade and commerce. This banking innovation directly relates to how value and capital are exchanged and circulated in the economy.

vsm_relevance — 4.0 / 5.0

Cash accounts map well to S1 (primary operations) as they are operational tools that enable merchants to conduct business more efficiently. They also have some S2 relevance as coordination mechanisms that smooth capital flows and reduce oscillations in merchant liquidity.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating how financial innovations can increase capital efficiency and enable larger-scale commerce. It demonstrates a concrete mechanism by which banking systems can amplify economic activity beyond what would be possible with purely cash-based transactions.

3.5 KiB Raw Blame History