feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: natural_course_of_things
evaluator: null
evaluated_at: '2026-02-23T05:58:30.418885'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly articulates a specific concept - the natural progression
of economic development from agriculture through manufacturing to foreign trade
when unimpeded by institutional interference. While comprehensive, it could be
slightly more concise, but it successfully avoids circularity and captures a distinct
theoretical construct.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text from Book III, Chapter
1, where he explicitly discusses the "natural course of things" and contrasts
it with actual historical development patterns. The definition accurately reflects
Smith's argument about the logical sequence of economic development and the role
of security preferences.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this concept
represents a foundational theoretical framework that underpins Smith''s broader
analysis of economic development. It''s not specific to any particular economic
sector but rather describes the overarching pattern of how economies naturally
evolve.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental
adaptation) as it describes how economic systems naturally adapt and evolve in
response to environmental conditions. However, it's somewhat abstract and could
also be viewed as a meta-principle that operates across multiple VSM systems.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by establishing a
theoretical benchmark against which actual economic development can be measured
and understood. It illuminates the underlying mechanisms driving economic evolution
and helps explain why certain development patterns are distorted or suboptimal.
---
# Evaluation: Natural Course Of Things
## definition_precision — 4.0 / 5.0
The definition clearly articulates a specific concept - the natural progression of economic development from agriculture through manufacturing to foreign trade when unimpeded by institutional interference. While comprehensive, it could be slightly more concise, but it successfully avoids circularity and captures a distinct theoretical construct.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text from Book III, Chapter 1, where he explicitly discusses the "natural course of things" and contrasts it with actual historical development patterns. The definition accurately reflects Smith's argument about the logical sequence of economic development and the role of security preferences.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this concept represents a foundational theoretical framework that underpins Smith's broader analysis of economic development. It's not specific to any particular economic sector but rather describes the overarching pattern of how economies naturally evolve.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how economic systems naturally adapt and evolve in response to environmental conditions. However, it's somewhat abstract and could also be viewed as a meta-principle that operates across multiple VSM systems.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by establishing a theoretical benchmark against which actual economic development can be measured and understood. It illuminates the underlying mechanisms driving economic evolution and helps explain why certain development patterns are distorted or suboptimal.