Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

mint

null

2026-02-23T05:53:36.199736

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly distinguishing a mint as a specific public institution with defined functions (stamping, certifying metal weight and fineness) and clear purpose (establishing currency trust). It captures a distinct institutional concept rather than a vague category.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses mints as institutions that certify metal currency to prevent fraud and facilitate exchange. The definition accurately reflects Smith's analysis of how mints solve practical problems in monetary systems.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is perfectly appropriate, as mints represent a regulatory institution that standardizes and certifies currency quality through official government authority. This clearly fits within the broader category of regulatory mechanisms that govern economic activity.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	The mint maps well to VSM System 3 (internal regulation/audit) as it provides standardization and quality control functions within the monetary system. It could also relate to S2 (coordination) by reducing transaction friction through standardized currency certification.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the institutional mechanism that solves the fundamental problem of currency trust and verification in metal-based monetary systems. It reveals how public institutions emerge to address specific coordination problems in exchange relationships.

Evaluation: Mint

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly distinguishing a mint as a specific public institution with defined functions (stamping, certifying metal weight and fineness) and clear purpose (establishing currency trust). It captures a distinct institutional concept rather than a vague category.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses mints as institutions that certify metal currency to prevent fraud and facilitate exchange. The definition accurately reflects Smith's analysis of how mints solve practical problems in monetary systems.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is perfectly appropriate, as mints represent a regulatory institution that standardizes and certifies currency quality through official government authority. This clearly fits within the broader category of regulatory mechanisms that govern economic activity.

vsm_relevance — 4.0 / 5.0

The mint maps well to VSM System 3 (internal regulation/audit) as it provides standardization and quality control functions within the monetary system. It could also relate to S2 (coordination) by reducing transaction friction through standardized currency certification.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the institutional mechanism that solves the fundamental problem of currency trust and verification in metal-based monetary systems. It reveals how public institutions emerge to address specific coordination problems in exchange relationships.

3.6 KiB Raw Blame History