feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: restraints_upon_importation
evaluator: null
evaluated_at: '2026-02-23T06:17:42.823246'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is clear and specific, distinguishing between complete
prohibitions and high tariffs as mechanisms to create domestic monopolies. It
avoids circularity and captures a distinct policy instrument rather than a vague
concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text, as Book IV, Chapter
2 explicitly examines restraints upon importation as a core protectionist mechanism.
The definition accurately reflects Smith's analysis of how these policies function
and their economic effects.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain assignment is precisely correct, as restraints
upon importation are fundamentally regulatory instruments that government uses
to control trade flows. This clearly distinguishes them from market mechanisms
or production concepts.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S3 (internal regulation) as it represents regulatory
mechanisms that control system boundaries and resource flows. It also has relevance
to S4 (intelligence) as these policies reflect responses to perceived environmental
threats from foreign competition.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by illuminating the
specific mechanism through which protectionist policies operate to distort market
competition. It reveals the structural relationship between trade policy, domestic
monopolization, and economic efficiency that is central to Smith's critique.
---
# Evaluation: Restraints Upon Importation
## definition_precision — 4.0 / 5.0
The definition is clear and specific, distinguishing between complete prohibitions and high tariffs as mechanisms to create domestic monopolies. It avoids circularity and captures a distinct policy instrument rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text, as Book IV, Chapter 2 explicitly examines restraints upon importation as a core protectionist mechanism. The definition accurately reflects Smith's analysis of how these policies function and their economic effects.
## domain_placement — 5.0 / 5.0
The "Regulation" domain assignment is precisely correct, as restraints upon importation are fundamentally regulatory instruments that government uses to control trade flows. This clearly distinguishes them from market mechanisms or production concepts.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S3 (internal regulation) as it represents regulatory mechanisms that control system boundaries and resource flows. It also has relevance to S4 (intelligence) as these policies reflect responses to perceived environmental threats from foreign competition.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by illuminating the specific mechanism through which protectionist policies operate to distort market competition. It reveals the structural relationship between trade policy, domestic monopolization, and economic efficiency that is central to Smith's critique.