Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

money

null

2026-02-23T05:54:44.988004

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies money as a "universally accepted medium of exchange" that solves barter's limitations, which is precise and non-circular. It could be slightly more precise about what makes something "universally accepted" but captures the essential functional concept well.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's Chapter 4 discussion of how money emerges from barter's inconveniences. The definition accurately reflects Smith's explanation of how certain commodities become accepted as exchange media, particularly metals due to their practical properties.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Exchange" domain is exactly correct, as money is fundamentally about facilitating exchange relationships. This is the natural conceptual home for understanding money's role in economic systems.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Money functions primarily as coordination infrastructure (S2) by enabling smooth exchange operations and reducing transaction friction. However, it's somewhat abstract as a pure medium rather than an active system component, making VSM placement less natural than for operational entities.

name	value	max_value	rationale
explanatory_value	5.0	5.0	Money provides excellent explanatory power by illuminating the fundamental mechanism that enables complex economic exchange beyond simple barter. It reveals how societies solve the structural problem of coordinating diverse individual preferences in trade relationships.

Evaluation: Money

definition_precision — 4.0 / 5.0

The definition clearly identifies money as a "universally accepted medium of exchange" that solves barter's limitations, which is precise and non-circular. It could be slightly more precise about what makes something "universally accepted" but captures the essential functional concept well.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's Chapter 4 discussion of how money emerges from barter's inconveniences. The definition accurately reflects Smith's explanation of how certain commodities become accepted as exchange media, particularly metals due to their practical properties.

domain_placement — 5.0 / 5.0

Placement in the "Exchange" domain is exactly correct, as money is fundamentally about facilitating exchange relationships. This is the natural conceptual home for understanding money's role in economic systems.

vsm_relevance — 3.0 / 5.0

Money functions primarily as coordination infrastructure (S2) by enabling smooth exchange operations and reducing transaction friction. However, it's somewhat abstract as a pure medium rather than an active system component, making VSM placement less natural than for operational entities.

explanatory_value — 5.0 / 5.0

Money provides excellent explanatory power by illuminating the fundamental mechanism that enables complex economic exchange beyond simple barter. It reveals how societies solve the structural problem of coordinating diverse individual preferences in trade relationships.

3.3 KiB Raw Blame History