feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,66 @@
|
||||
---
|
||||
entity_slug: maritime_commerce_development
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T05:42:47.487639'
|
||||
overall_score: 4.6
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly distinguishes maritime commerce development as
|
||||
a specific historical progression of sea-based trade that creates extensive markets,
|
||||
rather than just general trade. It includes the key insight about transportation
|
||||
cost advantages and sequential development patterns, making it a distinct concept.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is directly grounded in Smith's analysis in Book I, Chapter
|
||||
3, where he explicitly traces the historical development of commerce from Mediterranean
|
||||
maritime trade to coastal areas and navigable rivers before extending inland.
|
||||
The transportation cost logic and sequential development pattern are clearly present
|
||||
in the source text.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Exchange" domain is perfectly appropriate since this entity focuses
|
||||
on the mechanisms and patterns of trade development. Maritime commerce development
|
||||
is fundamentally about how exchange systems evolve and expand geographically based
|
||||
on transportation advantages.
|
||||
- name: vsm_relevance
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
|
||||
it describes how economic systems adapt to geographical and technological constraints
|
||||
to expand markets. It also has S1 relevance as it describes the operational development
|
||||
of trade networks that become primary economic activities.
|
||||
- name: explanatory_value
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity provides significant explanatory power by illuminating the
|
||||
structural mechanism behind economic development patterns - that transportation
|
||||
costs drive the sequence of market expansion from maritime to inland areas. It
|
||||
explains why certain regions develop economically before others and how specialization
|
||||
becomes possible.
|
||||
---
|
||||
|
||||
# Evaluation: Maritime Commerce Development
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly distinguishes maritime commerce development as a specific historical progression of sea-based trade that creates extensive markets, rather than just general trade. It includes the key insight about transportation cost advantages and sequential development patterns, making it a distinct concept.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This entity is directly grounded in Smith's analysis in Book I, Chapter 3, where he explicitly traces the historical development of commerce from Mediterranean maritime trade to coastal areas and navigable rivers before extending inland. The transportation cost logic and sequential development pattern are clearly present in the source text.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Exchange" domain is perfectly appropriate since this entity focuses on the mechanisms and patterns of trade development. Maritime commerce development is fundamentally about how exchange systems evolve and expand geographically based on transportation advantages.
|
||||
|
||||
## vsm_relevance — 4.0 / 5.0
|
||||
|
||||
This entity maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to geographical and technological constraints to expand markets. It also has S1 relevance as it describes the operational development of trade networks that become primary economic activities.
|
||||
|
||||
## explanatory_value — 5.0 / 5.0
|
||||
|
||||
This entity provides significant explanatory power by illuminating the structural mechanism behind economic development patterns - that transportation costs drive the sequence of market expansion from maritime to inland areas. It explains why certain regions develop economically before others and how specialization becomes possible.
|
||||
Reference in New Issue
Block a user