Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_policy_of_england

null

2026-02-23T04:59:13.930109

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a systematic approach to international trade with specific components (commercial treaties, colonial monopolies, trade restrictions) and distinguishes it from other trade approaches by its mercantilist foundation. It avoids circularity and captures a distinct policy framework rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book IV, Chapter 6 where Smith extensively critiques England's commercial policy and its mercantilist underpinnings. The definition accurately reflects Smith's analysis of how England pursued favorable trade balances through the specific mechanisms mentioned.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate as this entity concerns systematic government intervention in trade through policies, treaties, and restrictions. This is fundamentally about regulatory mechanisms rather than market operations or production processes.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents how England attempted to adapt to international competitive pressures through strategic policy, and partially to S5 (identity/policy) as it reflects national economic identity. The systematic nature of the policy makes it clearly VSM-relevant rather than abstract.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating the structural mechanism through which mercantilist principles were implemented in practice, helping explain why Smith viewed such policies as counterproductive. It goes beyond merely naming a phenomenon to describe an operational framework with identifiable components and effects.

Evaluation: Commercial Policy Of England

definition_precision — 4.0 / 5.0

The definition clearly identifies a systematic approach to international trade with specific components (commercial treaties, colonial monopolies, trade restrictions) and distinguishes it from other trade approaches by its mercantilist foundation. It avoids circularity and captures a distinct policy framework rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book IV, Chapter 6 where Smith extensively critiques England's commercial policy and its mercantilist underpinnings. The definition accurately reflects Smith's analysis of how England pursued favorable trade balances through the specific mechanisms mentioned.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate as this entity concerns systematic government intervention in trade through policies, treaties, and restrictions. This is fundamentally about regulatory mechanisms rather than market operations or production processes.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents how England attempted to adapt to international competitive pressures through strategic policy, and partially to S5 (identity/policy) as it reflects national economic identity. The systematic nature of the policy makes it clearly VSM-relevant rather than abstract.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating the structural mechanism through which mercantilist principles were implemented in practice, helping explain why Smith viewed such policies as counterproductive. It goes beyond merely naming a phenomenon to describe an operational framework with identifiable components and effects.

3.9 KiB Raw Blame History