feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: commercial_maxims_inversion
evaluator: null
evaluated_at: '2026-02-23T04:58:45.700501'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures a specific phenomenon - the inversion
of sound economic principles that leads nations to view others' prosperity as
threatening rather than beneficial. It's precise in describing both the mindset
and its policy consequences, though "perverse economic principles" could be slightly
more specific.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's critique of mercantile theory
throughout Book IV, where he repeatedly argues that mercantilism teaches nations
to view trade as zero-sum and to pursue policies that harm neighbors. The "inversion"
language accurately captures Smith's argument that mercantilism turns natural
economic reasoning upside down.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain since this represents a fundamental
theoretical critique of mercantile thinking that underlies Smith''s broader argument
about trade policy. It''s a meta-level concept about how economic reasoning itself
can be corrupted.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This maps well to S4 (intelligence/environmental adaptation) as it describes
how nations misinterpret their economic environment and relationships with other
nations. It could also relate to S5 (identity/policy) in terms of how nations
define their interests, making it quite relevant to VSM analysis.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by identifying the
underlying logical error that drives mercantile policy - the fundamental misunderstanding
of trade as zero-sum rather than positive-sum. It illuminates why nations consistently
adopt self-defeating trade policies despite evidence of their failure.
---
# Evaluation: Commercial Maxims Inversion
## definition_precision — 4.0 / 5.0
The definition clearly captures a specific phenomenon - the inversion of sound economic principles that leads nations to view others' prosperity as threatening rather than beneficial. It's precise in describing both the mindset and its policy consequences, though "perverse economic principles" could be slightly more specific.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's critique of mercantile theory throughout Book IV, where he repeatedly argues that mercantilism teaches nations to view trade as zero-sum and to pursue policies that harm neighbors. The "inversion" language accurately captures Smith's argument that mercantilism turns natural economic reasoning upside down.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain since this represents a fundamental theoretical critique of mercantile thinking that underlies Smith's broader argument about trade policy. It's a meta-level concept about how economic reasoning itself can be corrupted.
## vsm_relevance — 4.0 / 5.0
This maps well to S4 (intelligence/environmental adaptation) as it describes how nations misinterpret their economic environment and relationships with other nations. It could also relate to S5 (identity/policy) in terms of how nations define their interests, making it quite relevant to VSM analysis.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by identifying the underlying logical error that drives mercantile policy - the fundamental misunderstanding of trade as zero-sum rather than positive-sum. It illuminates why nations consistently adopt self-defeating trade policies despite evidence of their failure.