Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

coined_money

null

2026-02-23T04:44:03.352890

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly distinguishing coined money from unstamped metal by its official stamps indicating weight and fineness, and specifying the functional advantage of exchange by count rather than weight. It captures a distinct technological innovation in monetary systems.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses the invention of coins with official stamps and how they solve the practical problems of weighing and assaying metal bars. The definition accurately reflects Smith's analysis of this monetary innovation.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in the "Exchange" domain is perfectly appropriate, as coined money is fundamentally about facilitating exchange transactions by standardizing the medium of exchange. This represents a core mechanism within Smith's analysis of how exchange systems develop and function.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as it represents a standardization mechanism that reduces transaction friction and coordination problems in exchange systems. It also has some S1 relevance as a basic operational tool for primary economic activities.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating a crucial structural mechanism in the evolution of exchange systems—how official standardization solves information asymmetries and transaction costs. It explains a key step in the development from barter to monetary economies.

Evaluation: Coined Money

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly distinguishing coined money from unstamped metal by its official stamps indicating weight and fineness, and specifying the functional advantage of exchange by count rather than weight. It captures a distinct technological innovation in monetary systems.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses the invention of coins with official stamps and how they solve the practical problems of weighing and assaying metal bars. The definition accurately reflects Smith's analysis of this monetary innovation.

domain_placement — 5.0 / 5.0

The placement in the "Exchange" domain is perfectly appropriate, as coined money is fundamentally about facilitating exchange transactions by standardizing the medium of exchange. This represents a core mechanism within Smith's analysis of how exchange systems develop and function.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as it represents a standardization mechanism that reduces transaction friction and coordination problems in exchange systems. It also has some S1 relevance as a basic operational tool for primary economic activities.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating a crucial structural mechanism in the evolution of exchange systems—how official standardization solves information asymmetries and transaction costs. It explains a key step in the development from barter to monetary economies.

3.6 KiB Raw Blame History