Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_improvement

null

2026-02-23T00:27:19.914835

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and specific, clearly outlining concrete methods like crop rotation, drainage, and fencing that increase agricultural productivity. It avoids circularity and captures a distinct concept rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is strongly grounded in Smith's actual text, particularly Book I, Chapter 11, where he extensively discusses how improvements to land increase productivity and affect the distribution of economic benefits. The concept directly reflects Smith's analysis of agricultural development.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is exactly correct, as agricultural improvement is fundamentally about enhancing the productive capacity of land and farming operations. This is a core production-side economic concept in Smith's framework.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it concerns the fundamental productive activities of agriculture, and also connects to S4 (intelligence/adaptation) as improvements represent learning and adaptation to environmental conditions. It has clear operational relevance to viable system functioning.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the mechanism through which land becomes more productive and how this affects rent distribution between landlords, farmers, and consumers. It explains a fundamental driver of economic development in Smith's agricultural economy.

Evaluation: Agricultural Improvement

definition_precision — 4.0 / 5.0

The definition is precise and specific, clearly outlining concrete methods like crop rotation, drainage, and fencing that increase agricultural productivity. It avoids circularity and captures a distinct concept rather than being a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is strongly grounded in Smith's actual text, particularly Book I, Chapter 11, where he extensively discusses how improvements to land increase productivity and affect the distribution of economic benefits. The concept directly reflects Smith's analysis of agricultural development.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is exactly correct, as agricultural improvement is fundamentally about enhancing the productive capacity of land and farming operations. This is a core production-side economic concept in Smith's framework.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it concerns the fundamental productive activities of agriculture, and also connects to S4 (intelligence/adaptation) as improvements represent learning and adaptation to environmental conditions. It has clear operational relevance to viable system functioning.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the mechanism through which land becomes more productive and how this affects rent distribution between landlords, farmers, and consumers. It explains a fundamental driver of economic development in Smith's agricultural economy.

3.5 KiB Raw Blame History