Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

modern_states_inversion

null

2026-02-23T05:53:45.209141

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures a specific phenomenon - the reversal of natural economic development order where foreign commerce and manufacturing preceded agricultural improvement in European states. It avoids circularity and distinguishes this pattern from the "natural" progression Smith describes.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how European development followed an "unnatural and retrograde" order compared to the natural progression from agriculture to manufacturing to commerce. The entity accurately reflects Smith's own characterization of this historical pattern.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical insight about economic development patterns rather than a specific mechanism or policy. It operates at the level of broad structural analysis of economic evolution.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how societies adapted their development patterns in response to external opportunities and constraints. However, it's more of a historical-structural observation than an active system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides significant explanatory value by identifying a key structural pattern that helps explain European economic development and distinguishes it from Smith's theoretical ideal. It illuminates how historical circumstances can override "natural" economic tendencies, adding depth to understanding development processes.

Evaluation: Modern States Inversion

definition_precision — 4.0 / 5.0

The definition clearly captures a specific phenomenon - the reversal of natural economic development order where foreign commerce and manufacturing preceded agricultural improvement in European states. It avoids circularity and distinguishes this pattern from the "natural" progression Smith describes.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how European development followed an "unnatural and retrograde" order compared to the natural progression from agriculture to manufacturing to commerce. The entity accurately reflects Smith's own characterization of this historical pattern.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical insight about economic development patterns rather than a specific mechanism or policy. It operates at the level of broad structural analysis of economic evolution.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how societies adapted their development patterns in response to external opportunities and constraints. However, it's more of a historical-structural observation than an active system component.

explanatory_value — 4.0 / 5.0

The entity provides significant explanatory value by identifying a key structural pattern that helps explain European economic development and distinguishes it from Smith's theoretical ideal. It illuminates how historical circumstances can override "natural" economic tendencies, adding depth to understanding development processes.

3.8 KiB Raw Blame History