Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

navigable_rivers

null

2026-02-23T06:01:27.388257

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, distinguishing navigable rivers from ordinary waterways by their capacity for goods transportation and their role as "natural highways." It avoids circularity and captures the essential economic function that makes these rivers significant.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 3, where he explicitly discusses navigable rivers and provides concrete examples (Nile, Chinese rivers) to illustrate their economic importance. The concept emerges naturally from Smith's analysis rather than being imposed from external frameworks.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in the "Exchange" domain is precisely correct, as navigable rivers fundamentally enable and expand market exchange by connecting inland producers to broader markets. This infrastructure directly facilitates the circulation of goods that Smith identifies as central to economic development.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	While navigable rivers could be seen as S1 infrastructure (enabling primary operations) or S4 elements (environmental resources that shape adaptation), they don't map cleanly to any single VSM system. They're more accurately understood as foundational infrastructure that supports multiple VSM functions rather than embodying a specific cybernetic role.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the structural mechanism through which geography enables economic development—specifically how natural transportation networks extend markets inland and thereby support division of labor. It reveals a key causal relationship between physical infrastructure and economic organization.

Evaluation: Navigable Rivers

definition_precision — 4.0 / 5.0

The definition is clear and specific, distinguishing navigable rivers from ordinary waterways by their capacity for goods transportation and their role as "natural highways." It avoids circularity and captures the essential economic function that makes these rivers significant.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 3, where he explicitly discusses navigable rivers and provides concrete examples (Nile, Chinese rivers) to illustrate their economic importance. The concept emerges naturally from Smith's analysis rather than being imposed from external frameworks.

domain_placement — 5.0 / 5.0

The placement in the "Exchange" domain is precisely correct, as navigable rivers fundamentally enable and expand market exchange by connecting inland producers to broader markets. This infrastructure directly facilitates the circulation of goods that Smith identifies as central to economic development.

vsm_relevance — 3.0 / 5.0

While navigable rivers could be seen as S1 infrastructure (enabling primary operations) or S4 elements (environmental resources that shape adaptation), they don't map cleanly to any single VSM system. They're more accurately understood as foundational infrastructure that supports multiple VSM functions rather than embodying a specific cybernetic role.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the structural mechanism through which geography enables economic development—specifically how natural transportation networks extend markets inland and thereby support division of labor. It reveals a key causal relationship between physical infrastructure and economic organization.

3.9 KiB Raw Blame History