Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

mutual_servitude

null

2026-02-23T05:56:33.200524

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific concept of reciprocal economic dependency with concrete examples of what each party provides. It avoids circularity and distinguishes mutual servitude from simple trade by emphasizing the systematic, balanced nature of the relationship.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's text from Book III, Chapter 1, where he explicitly discusses the reciprocal dependency between town and country. The definition accurately reflects Smith's argument about how urban and rural areas serve each other's needs through specialization.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since mutual servitude describes the fundamental mechanism by which town and country exchange different types of goods and services. This is quintessentially about exchange relationships rather than production, distribution, or consumption per se.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance as it could map to S1 (primary operations of exchange) or S2 (coordination between different economic sectors). However, it's more of a structural relationship than a specific system function, making the VSM mapping somewhat forced.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the fundamental mechanism that drives economic interdependence and counters zero-sum thinking. It reveals how division of labor creates structural relationships that benefit both parties, which is central to Smith's economic theory.

Evaluation: Mutual Servitude

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific concept of reciprocal economic dependency with concrete examples of what each party provides. It avoids circularity and distinguishes mutual servitude from simple trade by emphasizing the systematic, balanced nature of the relationship.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's text from Book III, Chapter 1, where he explicitly discusses the reciprocal dependency between town and country. The definition accurately reflects Smith's argument about how urban and rural areas serve each other's needs through specialization.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since mutual servitude describes the fundamental mechanism by which town and country exchange different types of goods and services. This is quintessentially about exchange relationships rather than production, distribution, or consumption per se.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance as it could map to S1 (primary operations of exchange) or S2 (coordination between different economic sectors). However, it's more of a structural relationship than a specific system function, making the VSM mapping somewhat forced.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the fundamental mechanism that drives economic interdependence and counters zero-sum thinking. It reveals how division of labor creates structural relationships that benefit both parties, which is central to Smith's economic theory.

3.5 KiB Raw Blame History