feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: distant_country_subsistence
evaluator: null
evaluated_at: '2026-02-23T05:06:31.053790'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes this concept from typical local
town-country relationships by specifying the key differentiator - distance of
subsistence sources. It captures a distinct economic arrangement without being
circular, though it could be slightly more precise about what constitutes "very
distant."
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual discussion in Book III,
Chapter 1, where he explicitly addresses how towns can obtain subsistence from
distant countries as an exception to the general pattern. The concept directly
reflects Smith's acknowledgment of variations in the typical development model.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since this concept fundamentally
concerns trade relationships and the flow of goods between geographically separated
economic units. It's centrally about exchange mechanisms rather than production
or distribution per se.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it represents how economic systems adapt to environmental constraints through
long-distance trade relationships. It also has relevance to S1 (operations) in
terms of how primary subsistence needs are met through alternative channels.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by illuminating how international
trade can alter natural development patterns while maintaining fundamental dependencies.
It helps explain variations in economic development across different historical
contexts and geographical situations.
---
# Evaluation: Distant Country Subsistence
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes this concept from typical local town-country relationships by specifying the key differentiator - distance of subsistence sources. It captures a distinct economic arrangement without being circular, though it could be slightly more precise about what constitutes "very distant."
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual discussion in Book III, Chapter 1, where he explicitly addresses how towns can obtain subsistence from distant countries as an exception to the general pattern. The concept directly reflects Smith's acknowledgment of variations in the typical development model.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since this concept fundamentally concerns trade relationships and the flow of goods between geographically separated economic units. It's centrally about exchange mechanisms rather than production or distribution per se.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it represents how economic systems adapt to environmental constraints through long-distance trade relationships. It also has relevance to S1 (operations) in terms of how primary subsistence needs are met through alternative channels.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by illuminating how international trade can alter natural development patterns while maintaining fundamental dependencies. It helps explain variations in economic development across different historical contexts and geographical situations.