feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,65 @@
|
||||
---
|
||||
entity_slug: economic_spatial_organization
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T05:11:55.863747'
|
||||
overall_score: 4.2
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly distinguishes economic spatial organization as
|
||||
geographic distribution driven by natural advantages and market forces rather
|
||||
than government planning. It captures a distinct concept about how economic activities
|
||||
self-organize spatially, though it could be slightly more precise about the specific
|
||||
mechanisms involved.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This concept is well-grounded in Book IV, Chapter 6, where Smith extensively
|
||||
discusses how economic activities naturally organize geographically based on comparative
|
||||
advantages and argues against government interference in this process. The entity
|
||||
accurately reflects Smith's actual arguments about spatial economic organization.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Exchange" domain is appropriate since spatial organization fundamentally
|
||||
concerns how goods, services, and capital flow between different geographic locations
|
||||
based on market mechanisms. This is clearly about exchange relationships rather
|
||||
than production, distribution, or consumption per se.
|
||||
- name: vsm_relevance
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: This entity has moderate VSM relevance, potentially mapping to S1 (as
|
||||
operational geographic units) and S4 (as environmental adaptation to geographic
|
||||
constraints and opportunities). However, it's somewhat abstract and doesn't clearly
|
||||
fit into a single VSM system category.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The entity provides genuine explanatory power by illuminating the mechanism
|
||||
through which market forces create efficient geographic distribution of economic
|
||||
activities without central planning. It explains a key structural relationship
|
||||
between geography, comparative advantage, and market outcomes that Smith emphasizes.
|
||||
---
|
||||
|
||||
# Evaluation: Economic Spatial Organization
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly distinguishes economic spatial organization as geographic distribution driven by natural advantages and market forces rather than government planning. It captures a distinct concept about how economic activities self-organize spatially, though it could be slightly more precise about the specific mechanisms involved.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This concept is well-grounded in Book IV, Chapter 6, where Smith extensively discusses how economic activities naturally organize geographically based on comparative advantages and argues against government interference in this process. The entity accurately reflects Smith's actual arguments about spatial economic organization.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Exchange" domain is appropriate since spatial organization fundamentally concerns how goods, services, and capital flow between different geographic locations based on market mechanisms. This is clearly about exchange relationships rather than production, distribution, or consumption per se.
|
||||
|
||||
## vsm_relevance — 3.0 / 5.0
|
||||
|
||||
This entity has moderate VSM relevance, potentially mapping to S1 (as operational geographic units) and S4 (as environmental adaptation to geographic constraints and opportunities). However, it's somewhat abstract and doesn't clearly fit into a single VSM system category.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
The entity provides genuine explanatory power by illuminating the mechanism through which market forces create efficient geographic distribution of economic activities without central planning. It explains a key structural relationship between geography, comparative advantage, and market outcomes that Smith emphasizes.
|
||||
Reference in New Issue
Block a user