Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

cultivation_improvement_priority

null

2026-02-23T05:04:27.754902

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific economic principle about the temporal and logical ordering of agricultural versus manufacturing development. It avoids circularity and captures a distinct concept about developmental sequencing rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This principle is explicitly and extensively discussed in Book III, Chapter 1 of The Wealth of Nations, where Smith argues that the "industry which procures subsistence" must precede that which provides "convenience and luxury." The entity accurately reflects Smith's core argument about natural economic development order.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain is perfectly appropriate since this principle fundamentally concerns the sequencing and relationship between different modes of production (agricultural versus manufacturing). It deals with the structural foundations of productive activity.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents a strategic principle about how economic systems must adapt their development sequence to environmental and resource constraints. It also has relevance to S5 (identity/policy) as it defines fundamental developmental priorities.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides substantial explanatory power by illuminating the structural mechanism underlying economic development—why certain sequences are necessary rather than optional. It explains a fundamental constraint that shapes all subsequent economic organization and growth patterns.

Evaluation: Cultivation Improvement Priority

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific economic principle about the temporal and logical ordering of agricultural versus manufacturing development. It avoids circularity and captures a distinct concept about developmental sequencing rather than being a vague umbrella term.

source_grounding — 5.0 / 5.0

This principle is explicitly and extensively discussed in Book III, Chapter 1 of The Wealth of Nations, where Smith argues that the "industry which procures subsistence" must precede that which provides "convenience and luxury." The entity accurately reflects Smith's core argument about natural economic development order.

domain_placement — 5.0 / 5.0

The "Production" domain is perfectly appropriate since this principle fundamentally concerns the sequencing and relationship between different modes of production (agricultural versus manufacturing). It deals with the structural foundations of productive activity.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents a strategic principle about how economic systems must adapt their development sequence to environmental and resource constraints. It also has relevance to S5 (identity/policy) as it defines fundamental developmental priorities.

explanatory_value — 5.0 / 5.0

This entity provides substantial explanatory power by illuminating the structural mechanism underlying economic development—why certain sequences are necessary rather than optional. It explains a fundamental constraint that shapes all subsequent economic organization and growth patterns.

3.6 KiB Raw Blame History