feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: prohibition_of_exportation
evaluator: null
evaluated_at: '2026-02-23T06:11:13.527699'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes prohibition of exportation as government
bans on specific goods (particularly raw materials) with stated economic intentions.
It avoids circularity and captures a distinct policy mechanism rather than a vague
concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's analysis in Book IV, Chapter
8, where he specifically examines export prohibitions on materials like wool and
raw hides. The definition accurately reflects Smith's treatment of these policies
and their economic rationale.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain assignment, as export prohibitions
are clearly government regulatory interventions in markets. This fits perfectly
within Smith''s broader analysis of mercantile policies and trade restrictions.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity maps reasonably well to S3 (internal regulation) as it represents
government control mechanisms over economic flows. However, it could also relate
to S4 (environmental adaptation) regarding international trade responses, making
the VSM placement somewhat ambiguous.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: "The entity illuminates an important mechanism in Smith's critique of\
\ mercantilism\u2014how governments attempt to manipulate domestic production\
\ advantages through trade restrictions. It reveals the structural tension between\
\ protecting domestic industries and achieving overall economic efficiency."
---
# Evaluation: Prohibition Of Exportation
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes prohibition of exportation as government bans on specific goods (particularly raw materials) with stated economic intentions. It avoids circularity and captures a distinct policy mechanism rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's analysis in Book IV, Chapter 8, where he specifically examines export prohibitions on materials like wool and raw hides. The definition accurately reflects Smith's treatment of these policies and their economic rationale.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain assignment, as export prohibitions are clearly government regulatory interventions in markets. This fits perfectly within Smith's broader analysis of mercantile policies and trade restrictions.
## vsm_relevance — 3.0 / 5.0
This entity maps reasonably well to S3 (internal regulation) as it represents government control mechanisms over economic flows. However, it could also relate to S4 (environmental adaptation) regarding international trade responses, making the VSM placement somewhat ambiguous.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important mechanism in Smith's critique of mercantilism—how governments attempt to manipulate domestic production advantages through trade restrictions. It reveals the structural tension between protecting domestic industries and achieving overall economic efficiency.