Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_monetary_policy

null

2026-02-23T00:43:08.632105

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly delineates bank monetary policy as specific practices around note issuance, credit extension, and reserves, with concrete examples like discounting and cash accounts. It avoids circularity and captures a distinct operational concept rather than a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed analysis in Book II, Chapter 2, where he extensively examines bank operations, note circulation, discounting practices, and the policy decisions banks must make. The specific elements mentioned (discounting, cash accounts, note circulation) are all explicitly discussed by Smith.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate, as Smith's analysis focuses on how banks must regulate their own operations and the broader regulatory implications of their policy choices. This is fundamentally about institutional governance and control mechanisms.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to VSM System 3 (internal regulation) as it concerns how banks internally manage and control their operations to maintain stability. It also has elements of S4 (intelligence) in how banks must adapt their policies to environmental conditions and economic needs.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates important structural mechanisms about how banks maintain stability while serving economic functions, revealing the trade-offs and decision-making processes that Smith analyzes. It goes beyond surface description to capture the regulatory dynamics that Smith sees as crucial to banking operations.

Evaluation: Bank Monetary Policy

definition_precision — 4.0 / 5.0

The definition clearly delineates bank monetary policy as specific practices around note issuance, credit extension, and reserves, with concrete examples like discounting and cash accounts. It avoids circularity and captures a distinct operational concept rather than a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed analysis in Book II, Chapter 2, where he extensively examines bank operations, note circulation, discounting practices, and the policy decisions banks must make. The specific elements mentioned (discounting, cash accounts, note circulation) are all explicitly discussed by Smith.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate, as Smith's analysis focuses on how banks must regulate their own operations and the broader regulatory implications of their policy choices. This is fundamentally about institutional governance and control mechanisms.

vsm_relevance — 4.0 / 5.0

This entity maps well to VSM System 3 (internal regulation) as it concerns how banks internally manage and control their operations to maintain stability. It also has elements of S4 (intelligence) in how banks must adapt their policies to environmental conditions and economic needs.

explanatory_value — 4.0 / 5.0

The entity illuminates important structural mechanisms about how banks maintain stability while serving economic functions, revealing the trade-offs and decision-making processes that Smith analyzes. It goes beyond surface description to capture the regulatory dynamics that Smith sees as crucial to banking operations.

3.7 KiB Raw Blame History