feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: monopoly_of_trade
evaluator: null
evaluated_at: '2026-02-23T05:55:57.916458'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes monopoly of trade as government-granted
exclusive commercial privileges that restrict competition, with specific mechanisms
(artificially raised prices, reduced quality) and scope (domestic and colonial).
It avoids circularity and captures a distinct economic structure rather than a
vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is deeply grounded in Smith's actual analysis, particularly
Book IV Chapter 8 which extensively examines monopolistic trade practices, colonial
monopolies, and their effects on prices and consumer welfare. The definition accurately
reflects Smith's specific critiques of exclusive trading privileges.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain placement since monopolies of trade
are fundamentally about government-imposed market restrictions and regulatory
frameworks that constrain natural market operations. This fits perfectly within
Smith''s analysis of regulatory interference with free trade.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S3 (internal
regulation) as a regulatory mechanism that controls market access, and potentially
S4 (intelligence) regarding how governments manage trade relationships. However,
it's more of a structural constraint than an active system component.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory power by illuminating the
specific mechanism through which government intervention distorts natural market
operations, connecting regulatory structure to economic outcomes (higher prices,
reduced quality, restricted consumer choice). It reveals a key structural relationship
in Smith's critique of mercantilism.
---
# Evaluation: Monopoly Of Trade
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes monopoly of trade as government-granted exclusive commercial privileges that restrict competition, with specific mechanisms (artificially raised prices, reduced quality) and scope (domestic and colonial). It avoids circularity and captures a distinct economic structure rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is deeply grounded in Smith's actual analysis, particularly Book IV Chapter 8 which extensively examines monopolistic trade practices, colonial monopolies, and their effects on prices and consumer welfare. The definition accurately reflects Smith's specific critiques of exclusive trading privileges.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain placement since monopolies of trade are fundamentally about government-imposed market restrictions and regulatory frameworks that constrain natural market operations. This fits perfectly within Smith's analysis of regulatory interference with free trade.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S3 (internal regulation) as a regulatory mechanism that controls market access, and potentially S4 (intelligence) regarding how governments manage trade relationships. However, it's more of a structural constraint than an active system component.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory power by illuminating the specific mechanism through which government intervention distorts natural market operations, connecting regulatory structure to economic outcomes (higher prices, reduced quality, restricted consumer choice). It reveals a key structural relationship in Smith's critique of mercantilism.