Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

natural_progress_of_improvement

null

2026-02-23T06:00:50.204935

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific mechanism - the tendency of societies to improve through individual efforts when protected by law and liberty, with the power to overcome government interference. While "improvement" could be more precisely defined, the core concept of self-correcting economic progress is distinct and well-articulated.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's text from Book II, Chapter 3, where he explicitly discusses how individual frugality and the natural effort to better one's condition can overcome government prodigality and errors. The entity accurately captures Smith's optimistic view about England's progress despite public waste.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this represents one of Smith's fundamental theoretical principles about how economies function and self-correct. It's a meta-level concept that underlies much of his economic thinking rather than belonging to a specific operational category.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has some VSM relevance as it describes a self-regulating mechanism that could map to S3 (internal regulation) or S2 (anti-oscillation), but it's primarily a high-level theoretical principle rather than a specific systemic function. It's more of an emergent property of the entire viable system than a discrete component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by identifying the fundamental mechanism Smith believes drives economic progress and resilience. It explains how individual-level behaviors aggregate to create system-level stability and growth, even in the face of poor governance.

Evaluation: Natural Progress Of Improvement

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific mechanism - the tendency of societies to improve through individual efforts when protected by law and liberty, with the power to overcome government interference. While "improvement" could be more precisely defined, the core concept of self-correcting economic progress is distinct and well-articulated.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's text from Book II, Chapter 3, where he explicitly discusses how individual frugality and the natural effort to better one's condition can overcome government prodigality and errors. The entity accurately captures Smith's optimistic view about England's progress despite public waste.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this represents one of Smith's fundamental theoretical principles about how economies function and self-correct. It's a meta-level concept that underlies much of his economic thinking rather than belonging to a specific operational category.

vsm_relevance — 3.0 / 5.0

This entity has some VSM relevance as it describes a self-regulating mechanism that could map to S3 (internal regulation) or S2 (anti-oscillation), but it's primarily a high-level theoretical principle rather than a specific systemic function. It's more of an emergent property of the entire viable system than a discrete component.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by identifying the fundamental mechanism Smith believes drives economic progress and resilience. It explains how individual-level behaviors aggregate to create system-level stability and growth, even in the face of poor governance.

3.9 KiB Raw Blame History