feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: colonial_trade_monopoly
evaluator: null
evaluated_at: '2026-02-23T04:52:01.449625'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly specifies the exclusive commercial privileges
between Britain and its colonies, with concrete details about supplying European
commodities and geographical trade restrictions. It avoids circularity and captures
a distinct institutional arrangement rather than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Book IV, Chapter 4, which extensively
examines colonial trade restrictions and monopolistic practices. The context accurately
reflects Smith's analysis of how these monopolies functioned and were circumvented
in practice.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Exchange" is the correct domain placement, as this entity fundamentally
concerns trade relationships, commercial privileges, and market access restrictions.
The monopoly directly governs how exchange occurs between Britain and its colonies.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has some VSM relevance as it represents a regulatory mechanism
(S3) that attempts to control colonial economic activity, but it's primarily a
historical institutional arrangement rather than a clear organizational system
component. It operates more as an external constraint on viable systems than as
an internal VSM element.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides strong explanatory value by illuminating the structural
mechanism of how imperial powers attempted to extract economic benefits from colonies
and how market forces resisted such controls. It reveals important dynamics about
the tension between regulatory intent and actual market behavior.
---
# Evaluation: Colonial Trade Monopoly
## definition_precision — 4.0 / 5.0
The definition clearly specifies the exclusive commercial privileges between Britain and its colonies, with concrete details about supplying European commodities and geographical trade restrictions. It avoids circularity and captures a distinct institutional arrangement rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Book IV, Chapter 4, which extensively examines colonial trade restrictions and monopolistic practices. The context accurately reflects Smith's analysis of how these monopolies functioned and were circumvented in practice.
## domain_placement — 5.0 / 5.0
"Exchange" is the correct domain placement, as this entity fundamentally concerns trade relationships, commercial privileges, and market access restrictions. The monopoly directly governs how exchange occurs between Britain and its colonies.
## vsm_relevance — 3.0 / 5.0
This entity has some VSM relevance as it represents a regulatory mechanism (S3) that attempts to control colonial economic activity, but it's primarily a historical institutional arrangement rather than a clear organizational system component. It operates more as an external constraint on viable systems than as an internal VSM element.
## explanatory_value — 4.0 / 5.0
The entity provides strong explanatory value by illuminating the structural mechanism of how imperial powers attempted to extract economic benefits from colonies and how market forces resisted such controls. It reveals important dynamics about the tension between regulatory intent and actual market behavior.