Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_surplus

null

2026-02-23T00:32:03.090020

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and precise, distinguishing agricultural surplus as the specific excess beyond maintenance costs for farmers, laborers, and livestock. It avoids circularity and establishes concrete boundaries for what constitutes this surplus.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book I, Chapter 11, where he explicitly discusses how rent derives from the surplus produce of land after necessary cultivation costs. The entity accurately reflects Smith's theoretical framework without introducing foreign concepts.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain assignment, as agricultural surplus is fundamentally about the productive capacity of land and the output that exceeds input requirements. This fits naturally within production economics rather than exchange or distribution domains.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Agricultural surplus maps reasonably well to S1 (primary operations) as it represents the fundamental productive output of the agricultural system. However, it also has elements relevant to S3 (resource allocation) and S4 (environmental adaptation), making its VSM placement somewhat diffuse.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the fundamental mechanism underlying rent theory and the basis for non-agricultural economic activity. It reveals the structural relationship between agricultural productivity and broader economic organization in Smith's framework.

Evaluation: Agricultural Surplus

definition_precision — 4.0 / 5.0

The definition is clear and precise, distinguishing agricultural surplus as the specific excess beyond maintenance costs for farmers, laborers, and livestock. It avoids circularity and establishes concrete boundaries for what constitutes this surplus.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book I, Chapter 11, where he explicitly discusses how rent derives from the surplus produce of land after necessary cultivation costs. The entity accurately reflects Smith's theoretical framework without introducing foreign concepts.

domain_placement — 5.0 / 5.0

"Production" is the correct domain assignment, as agricultural surplus is fundamentally about the productive capacity of land and the output that exceeds input requirements. This fits naturally within production economics rather than exchange or distribution domains.

vsm_relevance — 3.0 / 5.0

Agricultural surplus maps reasonably well to S1 (primary operations) as it represents the fundamental productive output of the agricultural system. However, it also has elements relevant to S3 (resource allocation) and S4 (environmental adaptation), making its VSM placement somewhat diffuse.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the fundamental mechanism underlying rent theory and the basis for non-agricultural economic activity. It reveals the structural relationship between agricultural productivity and broader economic organization in Smith's framework.

3.5 KiB Raw Blame History