feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: bank_monetary_policy
evaluator: null
evaluated_at: '2026-02-23T00:43:08.632105'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly delineates bank monetary policy as specific practices
around note issuance, credit extension, and reserves, with concrete examples like
discounting and cash accounts. It avoids circularity and captures a distinct operational
concept rather than a vague umbrella term.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's detailed analysis in Book
II, Chapter 2, where he extensively examines bank operations, note circulation,
discounting practices, and the policy decisions banks must make. The specific
elements mentioned (discounting, cash accounts, note circulation) are all explicitly
discussed by Smith.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain assignment is highly appropriate, as Smith's
analysis focuses on how banks must regulate their own operations and the broader
regulatory implications of their policy choices. This is fundamentally about institutional
governance and control mechanisms.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to VSM System 3 (internal regulation) as it concerns
how banks internally manage and control their operations to maintain stability.
It also has elements of S4 (intelligence) in how banks must adapt their policies
to environmental conditions and economic needs.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity illuminates important structural mechanisms about how banks
maintain stability while serving economic functions, revealing the trade-offs
and decision-making processes that Smith analyzes. It goes beyond surface description
to capture the regulatory dynamics that Smith sees as crucial to banking operations.
---
# Evaluation: Bank Monetary Policy
## definition_precision — 4.0 / 5.0
The definition clearly delineates bank monetary policy as specific practices around note issuance, credit extension, and reserves, with concrete examples like discounting and cash accounts. It avoids circularity and captures a distinct operational concept rather than a vague umbrella term.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's detailed analysis in Book II, Chapter 2, where he extensively examines bank operations, note circulation, discounting practices, and the policy decisions banks must make. The specific elements mentioned (discounting, cash accounts, note circulation) are all explicitly discussed by Smith.
## domain_placement — 5.0 / 5.0
The "Regulation" domain assignment is highly appropriate, as Smith's analysis focuses on how banks must regulate their own operations and the broader regulatory implications of their policy choices. This is fundamentally about institutional governance and control mechanisms.
## vsm_relevance — 4.0 / 5.0
This entity maps well to VSM System 3 (internal regulation) as it concerns how banks internally manage and control their operations to maintain stability. It also has elements of S4 (intelligence) in how banks must adapt their policies to environmental conditions and economic needs.
## explanatory_value — 4.0 / 5.0
The entity illuminates important structural mechanisms about how banks maintain stability while serving economic functions, revealing the trade-offs and decision-making processes that Smith analyzes. It goes beyond surface description to capture the regulatory dynamics that Smith sees as crucial to banking operations.