feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: treaties_of_commerce
evaluator: null
evaluated_at: '2026-02-23T06:34:14.996644'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is precise and captures a distinct concept - formal agreements
creating preferential trade privileges through duty exemptions or reductions.
It clearly distinguishes treaties of commerce from general trade agreements by
specifying their monopolistic effects and asymmetric impacts on trading partners.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's analysis in Book IV, Chapter
6, where he explicitly discusses treaties of commerce and uses the 1703 England-Portugal
treaty as a detailed case study. The definition accurately reflects Smith's characterization
of these arrangements and their economic effects.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain placement is correct, as treaties of commerce
represent formal regulatory mechanisms that govern international trade relationships.
These agreements function as institutional constraints that shape market behavior
through legal frameworks rather than natural market forces.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: Treaties of commerce have some VSM relevance as S4 (intelligence/environmental
adaptation) mechanisms, representing how nations attempt to adapt to international
competitive pressures through formal agreements. However, they could also be viewed
as S3 (internal regulation) tools, making the VSM mapping somewhat ambiguous.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides strong explanatory value by illuminating the structural
mechanism through which nations create artificial competitive advantages and distort
natural trade patterns. It reveals how formal agreements can systematically benefit
one party while harming another, demonstrating Smith's broader critique of mercantile
policies.
---
# Evaluation: Treaties Of Commerce
## definition_precision — 4.0 / 5.0
The definition is precise and captures a distinct concept - formal agreements creating preferential trade privileges through duty exemptions or reductions. It clearly distinguishes treaties of commerce from general trade agreements by specifying their monopolistic effects and asymmetric impacts on trading partners.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's analysis in Book IV, Chapter 6, where he explicitly discusses treaties of commerce and uses the 1703 England-Portugal treaty as a detailed case study. The definition accurately reflects Smith's characterization of these arrangements and their economic effects.
## domain_placement — 5.0 / 5.0
The "Regulation" domain placement is correct, as treaties of commerce represent formal regulatory mechanisms that govern international trade relationships. These agreements function as institutional constraints that shape market behavior through legal frameworks rather than natural market forces.
## vsm_relevance — 3.0 / 5.0
Treaties of commerce have some VSM relevance as S4 (intelligence/environmental adaptation) mechanisms, representing how nations attempt to adapt to international competitive pressures through formal agreements. However, they could also be viewed as S3 (internal regulation) tools, making the VSM mapping somewhat ambiguous.
## explanatory_value — 4.0 / 5.0
This entity provides strong explanatory value by illuminating the structural mechanism through which nations create artificial competitive advantages and distort natural trade patterns. It reveals how formal agreements can systematically benefit one party while harming another, demonstrating Smith's broader critique of mercantile policies.