Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

exchequer

null

2026-02-23T05:24:34.805640

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies the exchequer as a specific institutional entity (royal treasury and financial administration) with a distinct operational characteristic (receiving payments by weight rather than tale). The definition is precise and non-circular, though it could be slightly more detailed about the administrative functions.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 4, where he specifically discusses the exchequer's practice of receiving money by weight even after the introduction of coined money. The context accurately reflects Smith's historical example about the transition in monetary systems.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate for the exchequer, as it represents a governmental regulatory and administrative institution responsible for financial oversight and revenue collection. This clearly falls within the regulatory apparatus of the state's economic system.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	The exchequer maps well to VSM System 3 (internal regulation/audit) as it represents the regulatory and monitoring function for financial flows within the economic system. It could also have elements of S1 (primary operations) in its revenue collection role, making it a strong fit for VSM analysis.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory value by illustrating the institutional mechanisms behind monetary transition and the conservative nature of administrative systems. It demonstrates how regulatory institutions adapt gradually to technological changes (coined money), revealing important structural dynamics in economic systems.

Evaluation: Exchequer

definition_precision — 4.0 / 5.0

The definition clearly identifies the exchequer as a specific institutional entity (royal treasury and financial administration) with a distinct operational characteristic (receiving payments by weight rather than tale). The definition is precise and non-circular, though it could be slightly more detailed about the administrative functions.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 4, where he specifically discusses the exchequer's practice of receiving money by weight even after the introduction of coined money. The context accurately reflects Smith's historical example about the transition in monetary systems.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate for the exchequer, as it represents a governmental regulatory and administrative institution responsible for financial oversight and revenue collection. This clearly falls within the regulatory apparatus of the state's economic system.

vsm_relevance — 4.0 / 5.0

The exchequer maps well to VSM System 3 (internal regulation/audit) as it represents the regulatory and monitoring function for financial flows within the economic system. It could also have elements of S1 (primary operations) in its revenue collection role, making it a strong fit for VSM analysis.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory value by illustrating the institutional mechanisms behind monetary transition and the conservative nature of administrative systems. It demonstrates how regulatory institutions adapt gradually to technological changes (coined money), revealing important structural dynamics in economic systems.

3.8 KiB Raw Blame History