feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: natural_progress_of_improvement
evaluator: null
evaluated_at: '2026-02-23T06:00:50.204935'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies a specific mechanism - the tendency
of societies to improve through individual efforts when protected by law and liberty,
with the power to overcome government interference. While "improvement" could
be more precisely defined, the core concept of self-correcting economic progress
is distinct and well-articulated.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's text from Book II, Chapter
3, where he explicitly discusses how individual frugality and the natural effort
to better one's condition can overcome government prodigality and errors. The
entity accurately captures Smith's optimistic view about England's progress despite
public waste.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this represents
one of Smith''s fundamental theoretical principles about how economies function
and self-correct. It''s a meta-level concept that underlies much of his economic
thinking rather than belonging to a specific operational category.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has some VSM relevance as it describes a self-regulating
mechanism that could map to S3 (internal regulation) or S2 (anti-oscillation),
but it's primarily a high-level theoretical principle rather than a specific systemic
function. It's more of an emergent property of the entire viable system than a
discrete component.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by identifying the
fundamental mechanism Smith believes drives economic progress and resilience.
It explains how individual-level behaviors aggregate to create system-level stability
and growth, even in the face of poor governance.
---
# Evaluation: Natural Progress Of Improvement
## definition_precision — 4.0 / 5.0
The definition clearly identifies a specific mechanism - the tendency of societies to improve through individual efforts when protected by law and liberty, with the power to overcome government interference. While "improvement" could be more precisely defined, the core concept of self-correcting economic progress is distinct and well-articulated.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's text from Book II, Chapter 3, where he explicitly discusses how individual frugality and the natural effort to better one's condition can overcome government prodigality and errors. The entity accurately captures Smith's optimistic view about England's progress despite public waste.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this represents one of Smith's fundamental theoretical principles about how economies function and self-correct. It's a meta-level concept that underlies much of his economic thinking rather than belonging to a specific operational category.
## vsm_relevance — 3.0 / 5.0
This entity has some VSM relevance as it describes a self-regulating mechanism that could map to S3 (internal regulation) or S2 (anti-oscillation), but it's primarily a high-level theoretical principle rather than a specific systemic function. It's more of an emergent property of the entire viable system than a discrete component.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by identifying the fundamental mechanism Smith believes drives economic progress and resilience. It explains how individual-level behaviors aggregate to create system-level stability and growth, even in the face of poor governance.