feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: annual_coinage_expense_justification
evaluator: null
evaluated_at: '2026-02-23T00:33:05.318031'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes between unjustified coinage expenses
and the proper alternative of seignorage revenue generation. It captures a specific
economic mechanism rather than a vague concept, though it could be slightly more
precise about what constitutes "appropriate seignorage."
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's detailed analysis in Book
IV, Chapter 6, where he explicitly discusses the costs of government coinage operations
and argues for seignorage as an alternative to gratuitous coinage. The concept
reflects Smith's actual reasoning rather than imposing external interpretations.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain is perfectly appropriate since this concerns
government policy decisions about coinage operations, public expenditure justification,
and the regulatory choice between free coinage versus seignorage. This is fundamentally
about how government should regulate monetary operations.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S3 (internal regulation/audit) as it concerns
evaluating and justifying government expenditures, and potentially to S5 (policy)
regarding fundamental decisions about coinage operations. The concept has clear
VSM relevance in terms of organizational resource allocation and policy choices.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity illuminates an important structural mechanism in Smith's monetary
theory - how government coinage policy creates unnecessary subsidies and how proper
pricing (seignorage) could eliminate costs while generating revenue. It reveals
the economic logic behind institutional design choices rather than merely describing
surface phenomena.
---
# Evaluation: Annual Coinage Expense Justification
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes between unjustified coinage expenses and the proper alternative of seignorage revenue generation. It captures a specific economic mechanism rather than a vague concept, though it could be slightly more precise about what constitutes "appropriate seignorage."
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's detailed analysis in Book IV, Chapter 6, where he explicitly discusses the costs of government coinage operations and argues for seignorage as an alternative to gratuitous coinage. The concept reflects Smith's actual reasoning rather than imposing external interpretations.
## domain_placement — 5.0 / 5.0
The "Regulation" domain is perfectly appropriate since this concerns government policy decisions about coinage operations, public expenditure justification, and the regulatory choice between free coinage versus seignorage. This is fundamentally about how government should regulate monetary operations.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S3 (internal regulation/audit) as it concerns evaluating and justifying government expenditures, and potentially to S5 (policy) regarding fundamental decisions about coinage operations. The concept has clear VSM relevance in terms of organizational resource allocation and policy choices.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important structural mechanism in Smith's monetary theory - how government coinage policy creates unnecessary subsidies and how proper pricing (seignorage) could eliminate costs while generating revenue. It reveals the economic logic behind institutional design choices rather than merely describing surface phenomena.