feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: modern_states_inversion
evaluator: null
evaluated_at: '2026-02-23T05:53:45.209141'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures a specific phenomenon - the reversal
of natural economic development order where foreign commerce and manufacturing
preceded agricultural improvement in European states. It avoids circularity and
distinguishes this pattern from the "natural" progression Smith describes.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's analysis in Book III, Chapter
1, where he explicitly discusses how European development followed an "unnatural
and retrograde" order compared to the natural progression from agriculture to
manufacturing to commerce. The entity accurately reflects Smith's own characterization
of this historical pattern.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this concept
represents a fundamental theoretical insight about economic development patterns
rather than a specific mechanism or policy. It operates at the level of broad
structural analysis of economic evolution.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental
adaptation) as it describes how societies adapted their development patterns in
response to external opportunities and constraints. However, it's more of a historical-structural
observation than an active system component.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides significant explanatory value by identifying a key
structural pattern that helps explain European economic development and distinguishes
it from Smith's theoretical ideal. It illuminates how historical circumstances
can override "natural" economic tendencies, adding depth to understanding development
processes.
---
# Evaluation: Modern States Inversion
## definition_precision — 4.0 / 5.0
The definition clearly captures a specific phenomenon - the reversal of natural economic development order where foreign commerce and manufacturing preceded agricultural improvement in European states. It avoids circularity and distinguishes this pattern from the "natural" progression Smith describes.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how European development followed an "unnatural and retrograde" order compared to the natural progression from agriculture to manufacturing to commerce. The entity accurately reflects Smith's own characterization of this historical pattern.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical insight about economic development patterns rather than a specific mechanism or policy. It operates at the level of broad structural analysis of economic evolution.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how societies adapted their development patterns in response to external opportunities and constraints. However, it's more of a historical-structural observation than an active system component.
## explanatory_value — 4.0 / 5.0
The entity provides significant explanatory value by identifying a key structural pattern that helps explain European economic development and distinguishes it from Smith's theoretical ideal. It illuminates how historical circumstances can override "natural" economic tendencies, adding depth to understanding development processes.