Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_country_ruin_predictions

null

2026-02-23T04:57:33.742231

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures a specific phenomenon - the pattern of failed predictions by mercantilists about economic ruin from free trade. It's precise in identifying both the predictors (mercantile theory proponents) and the consistent falsification of their forecasts.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit observations in Book IV, Chapter 3, where he specifically notes that mercantile warnings about ruin from trade deficits have proven false while open trading nations have prospered. The concept emerges clearly from Smith's own analysis.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this entity represents a meta-theoretical observation about the predictive failures of mercantile economic theory. It's not about specific trade mechanisms but about theoretical frameworks and their empirical track records.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic theories process environmental information and make predictions about systemic survival. The pattern of failed predictions reveals deficiencies in mercantile theory's intelligence function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides significant explanatory value by identifying a systematic pattern of theoretical failure that undermines mercantile credibility. It illuminates how empirical evidence contradicts mercantile predictions, strengthening Smith's case for free trade policies.

Evaluation: Commercial Country Ruin Predictions

definition_precision — 4.0 / 5.0

The definition clearly captures a specific phenomenon - the pattern of failed predictions by mercantilists about economic ruin from free trade. It's precise in identifying both the predictors (mercantile theory proponents) and the consistent falsification of their forecasts.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit observations in Book IV, Chapter 3, where he specifically notes that mercantile warnings about ruin from trade deficits have proven false while open trading nations have prospered. The concept emerges clearly from Smith's own analysis.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this entity represents a meta-theoretical observation about the predictive failures of mercantile economic theory. It's not about specific trade mechanisms but about theoretical frameworks and their empirical track records.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic theories process environmental information and make predictions about systemic survival. The pattern of failed predictions reveals deficiencies in mercantile theory's intelligence function.

explanatory_value — 4.0 / 5.0

The entity provides significant explanatory value by identifying a systematic pattern of theoretical failure that undermines mercantile credibility. It illuminates how empirical evidence contradicts mercantile predictions, strengthening Smith's case for free trade policies.

3.5 KiB Raw Blame History