Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_surplus_determination

null

2026-02-23T00:31:54.632010

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific economic calculation (excess after subsistence needs) and its function as a development constraint. It avoids circularity and captures a distinct measurable concept rather than a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how agricultural surplus determines the extent of urban development possible. The entity accurately reflects Smith's foundational argument about the relationship between agricultural productivity and commercial society.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain placement since this concept deals with the fundamental productive capacity that enables economic development. It represents the core production constraint that determines all subsequent economic possibilities.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has some relevance to S1 (primary operations) as it concerns fundamental productive capacity, but it's more of a structural constraint than an operational system component. It doesn't map cleanly to any specific VSM system, being more of an environmental parameter.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides crucial explanatory power by illuminating the fundamental mechanism that enables the transition from subsistence to commercial society. It explains why urban development and specialization are impossible without sufficient agricultural productivity, making it a key structural relation in Smith's economic theory.

Evaluation: Agricultural Surplus Determination

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific economic calculation (excess after subsistence needs) and its function as a development constraint. It avoids circularity and captures a distinct measurable concept rather than a vague umbrella term.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how agricultural surplus determines the extent of urban development possible. The entity accurately reflects Smith's foundational argument about the relationship between agricultural productivity and commercial society.

domain_placement — 5.0 / 5.0

"Production" is the correct domain placement since this concept deals with the fundamental productive capacity that enables economic development. It represents the core production constraint that determines all subsequent economic possibilities.

vsm_relevance — 3.0 / 5.0

This entity has some relevance to S1 (primary operations) as it concerns fundamental productive capacity, but it's more of a structural constraint than an operational system component. It doesn't map cleanly to any specific VSM system, being more of an environmental parameter.

explanatory_value — 5.0 / 5.0

This entity provides crucial explanatory power by illuminating the fundamental mechanism that enables the transition from subsistence to commercial society. It explains why urban development and specialization are impossible without sufficient agricultural productivity, making it a key structural relation in Smith's economic theory.

3.6 KiB Raw Blame History