Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

subsistence_industry_priority

null

2026-02-23T06:26:54.410735

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific economic principle about the temporal and logical sequence of industry development, distinguishing between necessities, conveniences, and luxuries. It avoids circularity and captures a distinct developmental concept with clear causal implications.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Book III, Chapter 1 of The Wealth of Nations, where Smith explicitly discusses the natural order of economic development and the priority of agriculture over manufacturing. The entity accurately reflects Smith's argument about the foundational role of subsistence production.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate, as this principle fundamentally concerns the organization and sequencing of productive activities. The concept directly addresses how different types of production relate to each other in economic development.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it defines the foundational productive activities that must exist first, and to S4 (intelligence/adaptation) as it represents a strategic principle for understanding environmental constraints on development. The temporal sequencing aspect gives it clear VSM relevance.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanism underlying economic development sequences and explaining why certain development paths succeed while others fail. It reveals the logical foundation for Smith's broader arguments about natural economic progression.

Evaluation: Subsistence Industry Priority

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific economic principle about the temporal and logical sequence of industry development, distinguishing between necessities, conveniences, and luxuries. It avoids circularity and captures a distinct developmental concept with clear causal implications.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Book III, Chapter 1 of The Wealth of Nations, where Smith explicitly discusses the natural order of economic development and the priority of agriculture over manufacturing. The entity accurately reflects Smith's argument about the foundational role of subsistence production.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate, as this principle fundamentally concerns the organization and sequencing of productive activities. The concept directly addresses how different types of production relate to each other in economic development.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it defines the foundational productive activities that must exist first, and to S4 (intelligence/adaptation) as it represents a strategic principle for understanding environmental constraints on development. The temporal sequencing aspect gives it clear VSM relevance.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanism underlying economic development sequences and explaining why certain development paths succeed while others fail. It reveals the logical foundation for Smith's broader arguments about natural economic progression.

3.7 KiB Raw Blame History