Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

sea_coast_development

null

2026-02-23T06:20:08.640950

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific developmental pattern where coastal regions develop economically before inland areas due to water transport advantages. It avoids circularity and captures a distinct geographic-economic phenomenon rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit argument in Book I, Chapter 3, where he discusses how improvements in arts and industry begin where water-carriage opens markets. The examples of North American colonies and Mediterranean civilizations are specifically mentioned by Smith.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Production" domain is appropriate since this concept relates to how productive activities and industrial development emerge geographically. However, it could arguably also fit in a "Trade" or "Geography" domain given its emphasis on market access and spatial development patterns.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to environmental advantages like coastal access. However, it's more of a developmental pattern than a functional system component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides strong explanatory power by illuminating the mechanism behind geographic patterns of economic development - specifically how transportation costs and market access drive the spatial sequence of industrialization. It explains why certain regions develop first rather than merely describing that they do.

Evaluation: Sea Coast Development

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific developmental pattern where coastal regions develop economically before inland areas due to water transport advantages. It avoids circularity and captures a distinct geographic-economic phenomenon rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit argument in Book I, Chapter 3, where he discusses how improvements in arts and industry begin where water-carriage opens markets. The examples of North American colonies and Mediterranean civilizations are specifically mentioned by Smith.

domain_placement — 4.0 / 5.0

The "Production" domain is appropriate since this concept relates to how productive activities and industrial development emerge geographically. However, it could arguably also fit in a "Trade" or "Geography" domain given its emphasis on market access and spatial development patterns.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to environmental advantages like coastal access. However, it's more of a developmental pattern than a functional system component.

explanatory_value — 5.0 / 5.0

This entity provides strong explanatory power by illuminating the mechanism behind geographic patterns of economic development - specifically how transportation costs and market access drive the spatial sequence of industrialization. It explains why certain regions develop first rather than merely describing that they do.

3.6 KiB Raw Blame History