Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_connectivity_importance

null

2026-02-23T05:09:32.264894

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies connectivity as the enabling factor for division of labor and market expansion, with specific mechanisms outlined. While "critical role" could be more precise, the definition successfully captures a distinct economic concept rather than a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is strongly grounded in Smith's actual analysis in Book I, Chapter 3, where he extensively discusses water-carriage, navigable rivers, and how transportation connections enable market expansion. The examples cited (water-carriage, navigable rivers, political barriers) directly reflect Smith's text.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since connectivity fundamentally enables the exchange relationships that allow markets to function and expand. This concept sits at the heart of how exchange systems operate across geographic and economic boundaries.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (the operational connections between economic units) and S4 (intelligence about environmental opportunities for market expansion). The connectivity concept represents both operational infrastructure and strategic intelligence about market possibilities.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides genuine explanatory power by illuminating the structural mechanism through which markets expand and economies develop. It explains why some regions prosper while others remain isolated, making it a key causal factor rather than just a descriptive label.

Evaluation: Economic Connectivity Importance

definition_precision — 4.0 / 5.0

The definition clearly identifies connectivity as the enabling factor for division of labor and market expansion, with specific mechanisms outlined. While "critical role" could be more precise, the definition successfully captures a distinct economic concept rather than a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is strongly grounded in Smith's actual analysis in Book I, Chapter 3, where he extensively discusses water-carriage, navigable rivers, and how transportation connections enable market expansion. The examples cited (water-carriage, navigable rivers, political barriers) directly reflect Smith's text.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since connectivity fundamentally enables the exchange relationships that allow markets to function and expand. This concept sits at the heart of how exchange systems operate across geographic and economic boundaries.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (the operational connections between economic units) and S4 (intelligence about environmental opportunities for market expansion). The connectivity concept represents both operational infrastructure and strategic intelligence about market possibilities.

explanatory_value — 5.0 / 5.0

This entity provides genuine explanatory power by illuminating the structural mechanism through which markets expand and economies develop. It explains why some regions prosper while others remain isolated, making it a key causal factor rather than just a descriptive label.

3.5 KiB Raw Blame History