feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: commercial_country_ruin_predictions
evaluator: null
evaluated_at: '2026-02-23T04:57:33.742231'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures a specific phenomenon - the pattern of
failed predictions by mercantilists about economic ruin from free trade. It's
precise in identifying both the predictors (mercantile theory proponents) and
the consistent falsification of their forecasts.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's explicit observations in
Book IV, Chapter 3, where he specifically notes that mercantile warnings about
ruin from trade deficits have proven false while open trading nations have prospered.
The concept emerges clearly from Smith's own analysis.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this entity
represents a meta-theoretical observation about the predictive failures of mercantile
economic theory. It''s not about specific trade mechanisms but about theoretical
frameworks and their empirical track records.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it concerns how economic theories process environmental information and make predictions
about systemic survival. The pattern of failed predictions reveals deficiencies
in mercantile theory's intelligence function.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides significant explanatory value by identifying a systematic
pattern of theoretical failure that undermines mercantile credibility. It illuminates
how empirical evidence contradicts mercantile predictions, strengthening Smith's
case for free trade policies.
---
# Evaluation: Commercial Country Ruin Predictions
## definition_precision — 4.0 / 5.0
The definition clearly captures a specific phenomenon - the pattern of failed predictions by mercantilists about economic ruin from free trade. It's precise in identifying both the predictors (mercantile theory proponents) and the consistent falsification of their forecasts.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's explicit observations in Book IV, Chapter 3, where he specifically notes that mercantile warnings about ruin from trade deficits have proven false while open trading nations have prospered. The concept emerges clearly from Smith's own analysis.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this entity represents a meta-theoretical observation about the predictive failures of mercantile economic theory. It's not about specific trade mechanisms but about theoretical frameworks and their empirical track records.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic theories process environmental information and make predictions about systemic survival. The pattern of failed predictions reveals deficiencies in mercantile theory's intelligence function.
## explanatory_value — 4.0 / 5.0
The entity provides significant explanatory value by identifying a systematic pattern of theoretical failure that undermines mercantile credibility. It illuminates how empirical evidence contradicts mercantile predictions, strengthening Smith's case for free trade policies.