Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

subsistence_prioritization

null

2026-02-23T06:27:21.150840

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific economic hierarchy principle with distinct temporal and logical components. It avoids circularity by explaining both the prioritization mechanism and its developmental implications.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Book III, Chapter 1, where Smith explicitly discusses the natural order of economic development and why subsistence agriculture must precede manufacturing. The entity accurately reflects Smith's argument about the foundational role of necessities.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain assignment since this principle fundamentally concerns the ordering and sequencing of different types of productive activities. The concept directly addresses what gets produced when in economic development.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it defines the foundational productive activities that must exist first. However, it also touches on S4 (adaptation) regarding how economies naturally develop over time.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural logic underlying economic development sequences. It explains why certain economic arrangements emerge naturally and why attempts to bypass subsistence production typically fail.

Evaluation: Subsistence Prioritization

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific economic hierarchy principle with distinct temporal and logical components. It avoids circularity by explaining both the prioritization mechanism and its developmental implications.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Book III, Chapter 1, where Smith explicitly discusses the natural order of economic development and why subsistence agriculture must precede manufacturing. The entity accurately reflects Smith's argument about the foundational role of necessities.

domain_placement — 5.0 / 5.0

"Production" is the correct domain assignment since this principle fundamentally concerns the ordering and sequencing of different types of productive activities. The concept directly addresses what gets produced when in economic development.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it defines the foundational productive activities that must exist first. However, it also touches on S4 (adaptation) regarding how economies naturally develop over time.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural logic underlying economic development sequences. It explains why certain economic arrangements emerge naturally and why attempts to bypass subsistence production typically fail.

3.2 KiB Raw Blame History