feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,66 @@
|
||||
---
|
||||
entity_slug: agricultural_surplus_determination
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T00:31:54.632010'
|
||||
overall_score: 4.4
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly identifies a specific economic calculation (excess
|
||||
after subsistence needs) and its function as a development constraint. It avoids
|
||||
circularity and captures a distinct measurable concept rather than a vague umbrella
|
||||
term.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This concept is directly grounded in Smith's analysis in Book III, Chapter
|
||||
1, where he explicitly discusses how agricultural surplus determines the extent
|
||||
of urban development possible. The entity accurately reflects Smith's foundational
|
||||
argument about the relationship between agricultural productivity and commercial
|
||||
society.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: '"Production" is the correct domain placement since this concept deals
|
||||
with the fundamental productive capacity that enables economic development. It
|
||||
represents the core production constraint that determines all subsequent economic
|
||||
possibilities.'
|
||||
- name: vsm_relevance
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: This entity has some relevance to S1 (primary operations) as it concerns
|
||||
fundamental productive capacity, but it's more of a structural constraint than
|
||||
an operational system component. It doesn't map cleanly to any specific VSM system,
|
||||
being more of an environmental parameter.
|
||||
- name: explanatory_value
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity provides crucial explanatory power by illuminating the fundamental
|
||||
mechanism that enables the transition from subsistence to commercial society.
|
||||
It explains why urban development and specialization are impossible without sufficient
|
||||
agricultural productivity, making it a key structural relation in Smith's economic
|
||||
theory.
|
||||
---
|
||||
|
||||
# Evaluation: Agricultural Surplus Determination
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly identifies a specific economic calculation (excess after subsistence needs) and its function as a development constraint. It avoids circularity and captures a distinct measurable concept rather than a vague umbrella term.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how agricultural surplus determines the extent of urban development possible. The entity accurately reflects Smith's foundational argument about the relationship between agricultural productivity and commercial society.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
"Production" is the correct domain placement since this concept deals with the fundamental productive capacity that enables economic development. It represents the core production constraint that determines all subsequent economic possibilities.
|
||||
|
||||
## vsm_relevance — 3.0 / 5.0
|
||||
|
||||
This entity has some relevance to S1 (primary operations) as it concerns fundamental productive capacity, but it's more of a structural constraint than an operational system component. It doesn't map cleanly to any specific VSM system, being more of an environmental parameter.
|
||||
|
||||
## explanatory_value — 5.0 / 5.0
|
||||
|
||||
This entity provides crucial explanatory power by illuminating the fundamental mechanism that enables the transition from subsistence to commercial society. It explains why urban development and specialization are impossible without sufficient agricultural productivity, making it a key structural relation in Smith's economic theory.
|
||||
Reference in New Issue
Block a user