feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: commercial_policy_of_england
evaluator: null
evaluated_at: '2026-02-23T04:59:13.930109'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies a systematic approach to international
trade with specific components (commercial treaties, colonial monopolies, trade
restrictions) and distinguishes it from other trade approaches by its mercantilist
foundation. It avoids circularity and captures a distinct policy framework rather
than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Book IV, Chapter 6 where Smith extensively
critiques England's commercial policy and its mercantilist underpinnings. The
definition accurately reflects Smith's analysis of how England pursued favorable
trade balances through the specific mechanisms mentioned.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain is perfectly appropriate as this entity concerns
systematic government intervention in trade through policies, treaties, and restrictions.
This is fundamentally about regulatory mechanisms rather than market operations
or production processes.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it represents how England attempted to adapt to international competitive pressures
through strategic policy, and partially to S5 (identity/policy) as it reflects
national economic identity. The systematic nature of the policy makes it clearly
VSM-relevant rather than abstract.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by illuminating the structural
mechanism through which mercantilist principles were implemented in practice,
helping explain why Smith viewed such policies as counterproductive. It goes beyond
merely naming a phenomenon to describe an operational framework with identifiable
components and effects.
---
# Evaluation: Commercial Policy Of England
## definition_precision — 4.0 / 5.0
The definition clearly identifies a systematic approach to international trade with specific components (commercial treaties, colonial monopolies, trade restrictions) and distinguishes it from other trade approaches by its mercantilist foundation. It avoids circularity and captures a distinct policy framework rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Book IV, Chapter 6 where Smith extensively critiques England's commercial policy and its mercantilist underpinnings. The definition accurately reflects Smith's analysis of how England pursued favorable trade balances through the specific mechanisms mentioned.
## domain_placement — 5.0 / 5.0
The "Regulation" domain is perfectly appropriate as this entity concerns systematic government intervention in trade through policies, treaties, and restrictions. This is fundamentally about regulatory mechanisms rather than market operations or production processes.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it represents how England attempted to adapt to international competitive pressures through strategic policy, and partially to S5 (identity/policy) as it reflects national economic identity. The systematic nature of the policy makes it clearly VSM-relevant rather than abstract.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by illuminating the structural mechanism through which mercantilist principles were implemented in practice, helping explain why Smith viewed such policies as counterproductive. It goes beyond merely naming a phenomenon to describe an operational framework with identifiable components and effects.