Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

maritime_commerce_development

null

2026-02-23T05:42:47.487639

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes maritime commerce development as a specific historical progression of sea-based trade that creates extensive markets, rather than just general trade. It includes the key insight about transportation cost advantages and sequential development patterns, making it a distinct concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis in Book I, Chapter 3, where he explicitly traces the historical development of commerce from Mediterranean maritime trade to coastal areas and navigable rivers before extending inland. The transportation cost logic and sequential development pattern are clearly present in the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this entity focuses on the mechanisms and patterns of trade development. Maritime commerce development is fundamentally about how exchange systems evolve and expand geographically based on transportation advantages.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to geographical and technological constraints to expand markets. It also has S1 relevance as it describes the operational development of trade networks that become primary economic activities.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanism behind economic development patterns - that transportation costs drive the sequence of market expansion from maritime to inland areas. It explains why certain regions develop economically before others and how specialization becomes possible.

Evaluation: Maritime Commerce Development

definition_precision — 4.0 / 5.0

The definition clearly distinguishes maritime commerce development as a specific historical progression of sea-based trade that creates extensive markets, rather than just general trade. It includes the key insight about transportation cost advantages and sequential development patterns, making it a distinct concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis in Book I, Chapter 3, where he explicitly traces the historical development of commerce from Mediterranean maritime trade to coastal areas and navigable rivers before extending inland. The transportation cost logic and sequential development pattern are clearly present in the source text.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this entity focuses on the mechanisms and patterns of trade development. Maritime commerce development is fundamentally about how exchange systems evolve and expand geographically based on transportation advantages.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to geographical and technological constraints to expand markets. It also has S1 relevance as it describes the operational development of trade networks that become primary economic activities.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanism behind economic development patterns - that transportation costs drive the sequence of market expansion from maritime to inland areas. It explains why certain regions develop economically before others and how specialization becomes possible.

3.8 KiB Raw Blame History