feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: agricultural_surplus_determination
evaluator: null
evaluated_at: '2026-02-23T00:31:54.632010'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies a specific economic calculation (excess
after subsistence needs) and its function as a development constraint. It avoids
circularity and captures a distinct measurable concept rather than a vague umbrella
term.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's analysis in Book III, Chapter
1, where he explicitly discusses how agricultural surplus determines the extent
of urban development possible. The entity accurately reflects Smith's foundational
argument about the relationship between agricultural productivity and commercial
society.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Production" is the correct domain placement since this concept deals
with the fundamental productive capacity that enables economic development. It
represents the core production constraint that determines all subsequent economic
possibilities.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has some relevance to S1 (primary operations) as it concerns
fundamental productive capacity, but it's more of a structural constraint than
an operational system component. It doesn't map cleanly to any specific VSM system,
being more of an environmental parameter.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides crucial explanatory power by illuminating the fundamental
mechanism that enables the transition from subsistence to commercial society.
It explains why urban development and specialization are impossible without sufficient
agricultural productivity, making it a key structural relation in Smith's economic
theory.
---
# Evaluation: Agricultural Surplus Determination
## definition_precision — 4.0 / 5.0
The definition clearly identifies a specific economic calculation (excess after subsistence needs) and its function as a development constraint. It avoids circularity and captures a distinct measurable concept rather than a vague umbrella term.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how agricultural surplus determines the extent of urban development possible. The entity accurately reflects Smith's foundational argument about the relationship between agricultural productivity and commercial society.
## domain_placement — 5.0 / 5.0
"Production" is the correct domain placement since this concept deals with the fundamental productive capacity that enables economic development. It represents the core production constraint that determines all subsequent economic possibilities.
## vsm_relevance — 3.0 / 5.0
This entity has some relevance to S1 (primary operations) as it concerns fundamental productive capacity, but it's more of a structural constraint than an operational system component. It doesn't map cleanly to any specific VSM system, being more of an environmental parameter.
## explanatory_value — 5.0 / 5.0
This entity provides crucial explanatory power by illuminating the fundamental mechanism that enables the transition from subsistence to commercial society. It explains why urban development and specialization are impossible without sufficient agricultural productivity, making it a key structural relation in Smith's economic theory.