Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

mediterranean_civilisation_pattern

null

2026-02-23T05:50:08.456117

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific historical pattern of economic development tied to Mediterranean geography, avoiding circularity and capturing a distinct concept about how natural transportation advantages enable early specialization. The definition could be slightly more precise about what constitutes "early economic development" but is otherwise well-bounded.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 3, where he explicitly discusses how the Mediterranean's geographical features (smoothness, islands, proximity of shores) made it the first site of civilization due to accessible navigation. The entity accurately reflects Smith's argument without introducing external concepts.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this entity represents a broad theoretical principle about how geographical advantages create conditions for economic development and specialization. It's not specific to any particular economic mechanism but rather illustrates a foundational concept about the relationship between geography and economic progress.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is largely VSM-neutral as it describes a historical pattern rather than an operational system component. While it might loosely relate to S4 (environmental adaptation) in terms of how civilizations adapt to geographical advantages, it doesn't naturally map to specific VSM systems and remains too abstract for clear VSM placement.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating the mechanism through which geographical advantages (navigable waters) create structural conditions for trade, specialization, and economic development. It demonstrates a causal relationship between natural endowments and economic progress, though it represents more of a historical example than a generalizable economic principle.

Evaluation: Mediterranean Civilisation Pattern

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific historical pattern of economic development tied to Mediterranean geography, avoiding circularity and capturing a distinct concept about how natural transportation advantages enable early specialization. The definition could be slightly more precise about what constitutes "early economic development" but is otherwise well-bounded.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 3, where he explicitly discusses how the Mediterranean's geographical features (smoothness, islands, proximity of shores) made it the first site of civilization due to accessible navigation. The entity accurately reflects Smith's argument without introducing external concepts.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this entity represents a broad theoretical principle about how geographical advantages create conditions for economic development and specialization. It's not specific to any particular economic mechanism but rather illustrates a foundational concept about the relationship between geography and economic progress.

vsm_relevance — 2.0 / 5.0

This entity is largely VSM-neutral as it describes a historical pattern rather than an operational system component. While it might loosely relate to S4 (environmental adaptation) in terms of how civilizations adapt to geographical advantages, it doesn't naturally map to specific VSM systems and remains too abstract for clear VSM placement.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating the mechanism through which geographical advantages (navigable waters) create structural conditions for trade, specialization, and economic development. It demonstrates a causal relationship between natural endowments and economic progress, though it represents more of a historical example than a generalizable economic principle.

4.4 KiB Raw Blame History