Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_integration

null

2026-02-23T04:46:08.200645

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly specifies three concrete components of integration (trade relationships, capital flows, labor mobility) and explains the mechanism by which integration benefits colonies (specialization and market access). The concept is distinct and measurable rather than vague.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity directly reflects Smith's arguments in Book IV, Chapter 7 about how monopoly restrictions prevent colonies from participating fully in international commerce and achieving optimal economic development. The concept of integration capturing trade, capital, and labor flows aligns with Smith's analysis of colonial economic relationships.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the correct domain placement since this entity fundamentally concerns trade relationships, market participation, and the flow of goods, capital, and labor between colonies and global markets. These are core exchange mechanisms in Smith's framework.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how colonies adapt to and integrate with their broader economic environment. It also has relevance to S1 (primary operations) in terms of the actual trade and capital flows that constitute integration.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates the structural mechanism by which colonies achieve economic benefits through market participation and specialization according to comparative advantage. It explains why Smith opposes monopoly restrictions and provides a framework for understanding colonial economic development.

Evaluation: Colonial Economic Integration

definition_precision — 4.0 / 5.0

The definition clearly specifies three concrete components of integration (trade relationships, capital flows, labor mobility) and explains the mechanism by which integration benefits colonies (specialization and market access). The concept is distinct and measurable rather than vague.

source_grounding — 5.0 / 5.0

This entity directly reflects Smith's arguments in Book IV, Chapter 7 about how monopoly restrictions prevent colonies from participating fully in international commerce and achieving optimal economic development. The concept of integration capturing trade, capital, and labor flows aligns with Smith's analysis of colonial economic relationships.

domain_placement — 5.0 / 5.0

"Exchange" is the correct domain placement since this entity fundamentally concerns trade relationships, market participation, and the flow of goods, capital, and labor between colonies and global markets. These are core exchange mechanisms in Smith's framework.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how colonies adapt to and integrate with their broader economic environment. It also has relevance to S1 (primary operations) in terms of the actual trade and capital flows that constitute integration.

explanatory_value — 4.0 / 5.0

The entity illuminates the structural mechanism by which colonies achieve economic benefits through market participation and specialization according to comparative advantage. It explains why Smith opposes monopoly restrictions and provides a framework for understanding colonial economic development.

3.7 KiB Raw Blame History