Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

canal_communication

null

2026-02-23T04:39:50.366560

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes canal communication as artificial waterways that create extended networks, with specific emphasis on connecting previously isolated regions and reducing transportation costs. It avoids circularity and captures a distinct infrastructural concept rather than being vague.

name	value	max_value	rationale
source_grounding	5.0	5.0	The entity is directly grounded in Smith's specific examples of the Nile's canals in Lower Egypt, the Ganges, and Chinese river systems. The connection to market extent and division of labour reflects Smith's actual analysis of how these waterway networks enable economic development.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Exchange" domain is highly appropriate since canal communication directly facilitates the movement and exchange of goods between markets. This infrastructural element is fundamental to Smith's analysis of how exchange networks expand and operate.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Canal communication maps well to S1 (primary operations) as essential infrastructure enabling economic activity, and to S4 (intelligence/environmental adaptation) as it represents how societies adapt to geographical constraints to expand markets. It has clear operational relevance to viable economic systems.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial mechanism in Smith's theory—how physical infrastructure enables the expansion of markets and division of labour by overcoming geographical barriers. It explains the structural relationship between transportation networks and economic development rather than merely naming a surface phenomenon.

Evaluation: Canal Communication

definition_precision — 4.0 / 5.0

The definition clearly distinguishes canal communication as artificial waterways that create extended networks, with specific emphasis on connecting previously isolated regions and reducing transportation costs. It avoids circularity and captures a distinct infrastructural concept rather than being vague.

source_grounding — 5.0 / 5.0

The entity is directly grounded in Smith's specific examples of the Nile's canals in Lower Egypt, the Ganges, and Chinese river systems. The connection to market extent and division of labour reflects Smith's actual analysis of how these waterway networks enable economic development.

domain_placement — 5.0 / 5.0

Placement in the "Exchange" domain is highly appropriate since canal communication directly facilitates the movement and exchange of goods between markets. This infrastructural element is fundamental to Smith's analysis of how exchange networks expand and operate.

vsm_relevance — 4.0 / 5.0

Canal communication maps well to S1 (primary operations) as essential infrastructure enabling economic activity, and to S4 (intelligence/environmental adaptation) as it represents how societies adapt to geographical constraints to expand markets. It has clear operational relevance to viable economic systems.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial mechanism in Smith's theory—how physical infrastructure enables the expansion of markets and division of labour by overcoming geographical barriers. It explains the structural relationship between transportation networks and economic development rather than merely naming a surface phenomenon.

3.7 KiB Raw Blame History