Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

parsimony_and_privation

null

2026-02-23T06:04:36.693693

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes between two economic strategies - one based on saving/deprivation for commercial nations versus industry/enjoyment for agricultural nations. It's precise in identifying the specific contrast Smith draws, though it could be slightly more explicit about what constitutes "merchants, artificers, and manufacturers" versus agricultural systems.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity appears well-grounded in Book IV, Chapter 9, where Smith explicitly discusses different paths to wealth accumulation for different types of nations. The contrast between commercial nations requiring frugality versus agricultural nations being able to combine enjoyment with wealth creation is a genuine Smithian distinction.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Accumulation" domain is perfectly appropriate since this entity directly addresses different mechanisms by which nations accumulate wealth. The concept is fundamentally about capital formation and wealth-building strategies across different economic structures.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how different national economic structures must adapt different strategies based on their composition. However, it's more of a strategic principle than an operational system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illuminating why different economic structures require fundamentally different approaches to wealth accumulation. It reveals an important structural relationship between a nation's economic composition and its optimal growth strategy, going beyond surface description to explain underlying mechanisms.

Evaluation: Parsimony And Privation

definition_precision — 4.0 / 5.0

The definition clearly distinguishes between two economic strategies - one based on saving/deprivation for commercial nations versus industry/enjoyment for agricultural nations. It's precise in identifying the specific contrast Smith draws, though it could be slightly more explicit about what constitutes "merchants, artificers, and manufacturers" versus agricultural systems.

source_grounding — 5.0 / 5.0

This entity appears well-grounded in Book IV, Chapter 9, where Smith explicitly discusses different paths to wealth accumulation for different types of nations. The contrast between commercial nations requiring frugality versus agricultural nations being able to combine enjoyment with wealth creation is a genuine Smithian distinction.

domain_placement — 5.0 / 5.0

The "Accumulation" domain is perfectly appropriate since this entity directly addresses different mechanisms by which nations accumulate wealth. The concept is fundamentally about capital formation and wealth-building strategies across different economic structures.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how different national economic structures must adapt different strategies based on their composition. However, it's more of a strategic principle than an operational system component.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illuminating why different economic structures require fundamentally different approaches to wealth accumulation. It reveals an important structural relationship between a nation's economic composition and its optimal growth strategy, going beyond surface description to explain underlying mechanisms.

4.0 KiB Raw Blame History