Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_liquidity_management

null

2026-02-23T00:42:41.333898

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes bank liquidity management as the specific practice of balancing ready assets for obligations against credit provision capacity. It avoids circularity and captures a distinct operational concept rather than a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed analysis in Book II, Chapter 2, where he extensively discusses how banks must manage their cash reserves and note circulation to meet redemption demands while maintaining profitability. Smith explicitly examines this balance as fundamental to banking operations.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain placement is highly appropriate, as liquidity management represents the internal regulatory mechanisms banks must employ to maintain stability and meet obligations. This aligns perfectly with Smith's treatment of banking as requiring careful internal controls.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation/audit) as it represents the ongoing monitoring and control processes banks use to maintain operational stability. It also has elements of S2 (coordination) in managing the balance between competing demands on bank resources.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial mechanism Smith identifies for banking stability and broader economic function. It explains how individual bank practices aggregate to affect systemic financial stability, providing genuine insight into the structural relations between banking operations and economic outcomes.

Evaluation: Bank Liquidity Management

definition_precision — 4.0 / 5.0

The definition clearly distinguishes bank liquidity management as the specific practice of balancing ready assets for obligations against credit provision capacity. It avoids circularity and captures a distinct operational concept rather than a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed analysis in Book II, Chapter 2, where he extensively discusses how banks must manage their cash reserves and note circulation to meet redemption demands while maintaining profitability. Smith explicitly examines this balance as fundamental to banking operations.

domain_placement — 5.0 / 5.0

The "Regulation" domain placement is highly appropriate, as liquidity management represents the internal regulatory mechanisms banks must employ to maintain stability and meet obligations. This aligns perfectly with Smith's treatment of banking as requiring careful internal controls.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation/audit) as it represents the ongoing monitoring and control processes banks use to maintain operational stability. It also has elements of S2 (coordination) in managing the balance between competing demands on bank resources.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial mechanism Smith identifies for banking stability and broader economic function. It explains how individual bank practices aggregate to affect systemic financial stability, providing genuine insight into the structural relations between banking operations and economic outcomes.

3.6 KiB Raw Blame History