feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,65 @@
|
||||
---
|
||||
entity_slug: carriage_value_savings
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T04:41:55.332666'
|
||||
overall_score: 4.4
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly articulates a specific economic mechanism - the
|
||||
dual advantage of receiving transportation costs in selling prices while saving
|
||||
them in purchases. The concept is well-bounded and non-circular, though it could
|
||||
be slightly more precise about the exact mechanics of how this value transfer
|
||||
occurs.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This concept is directly grounded in Smith's analysis in Book III, Chapter
|
||||
1, where he explicitly discusses how proximity to towns affects both selling and
|
||||
purchasing advantages for rural producers. The entity accurately captures Smith's
|
||||
reasoning about spatial economic advantages without introducing foreign concepts.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Exchange" domain is perfectly appropriate, as this concept fundamentally
|
||||
concerns how market proximity affects the terms and costs of exchange transactions.
|
||||
The spatial dimension of exchange relationships is central to this concept's explanatory
|
||||
power.
|
||||
- name: vsm_relevance
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental
|
||||
adaptation) as it describes how economic actors adapt to their spatial environment
|
||||
to gain advantages. However, it's more of a structural economic relationship than
|
||||
a clear cybernetic function.
|
||||
- name: explanatory_value
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity provides excellent explanatory power by illuminating a specific
|
||||
mechanism that drives spatial economic inequality and land value differentials.
|
||||
It explains not just what happens (higher land values near towns) but precisely
|
||||
why it happens through the dual savings/revenue mechanism.
|
||||
---
|
||||
|
||||
# Evaluation: Carriage Value Savings
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly articulates a specific economic mechanism - the dual advantage of receiving transportation costs in selling prices while saving them in purchases. The concept is well-bounded and non-circular, though it could be slightly more precise about the exact mechanics of how this value transfer occurs.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how proximity to towns affects both selling and purchasing advantages for rural producers. The entity accurately captures Smith's reasoning about spatial economic advantages without introducing foreign concepts.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Exchange" domain is perfectly appropriate, as this concept fundamentally concerns how market proximity affects the terms and costs of exchange transactions. The spatial dimension of exchange relationships is central to this concept's explanatory power.
|
||||
|
||||
## vsm_relevance — 3.0 / 5.0
|
||||
|
||||
This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how economic actors adapt to their spatial environment to gain advantages. However, it's more of a structural economic relationship than a clear cybernetic function.
|
||||
|
||||
## explanatory_value — 5.0 / 5.0
|
||||
|
||||
This entity provides excellent explanatory power by illuminating a specific mechanism that drives spatial economic inequality and land value differentials. It explains not just what happens (higher land values near towns) but precisely why it happens through the dual savings/revenue mechanism.
|
||||
Reference in New Issue
Block a user