Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_freedom

null

2026-02-23T04:52:43.572510

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes colony economic freedom from metropolitan control, specifying key elements like trade, investment, and development according to comparative advantage. It avoids circularity and captures a distinct concept, though it could be slightly more precise about what constitutes "constraints by metropolitan economic interests."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is strongly grounded in Smith's actual arguments in Book V, Chapter 3, where he explicitly discusses colonial economic policy and advocates for greater freedom for colonies to pursue their economic interests. Smith directly argues that such freedom would benefit both colonies and mother countries through more efficient resource allocation.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate, as colonial economic freedom fundamentally concerns the regulatory framework governing colonial trade, investment, and economic development. This is clearly a matter of economic regulation and policy rather than production, exchange, or distribution per se.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to local conditions and comparative advantages. However, it also touches on S5 (identity/policy) regarding the fundamental policy framework governing colonial economies, making it somewhat distributed across systems.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides strong explanatory value by illuminating the structural relationship between metropolitan control and colonial economic efficiency. It helps explain Smith's mechanism whereby reducing regulatory constraints allows better resource allocation and mutual benefit, rather than merely naming a policy preference.

Evaluation: Colony Economic Freedom

definition_precision — 4.0 / 5.0

The definition clearly distinguishes colony economic freedom from metropolitan control, specifying key elements like trade, investment, and development according to comparative advantage. It avoids circularity and captures a distinct concept, though it could be slightly more precise about what constitutes "constraints by metropolitan economic interests."

source_grounding — 5.0 / 5.0

This entity is strongly grounded in Smith's actual arguments in Book V, Chapter 3, where he explicitly discusses colonial economic policy and advocates for greater freedom for colonies to pursue their economic interests. Smith directly argues that such freedom would benefit both colonies and mother countries through more efficient resource allocation.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate, as colonial economic freedom fundamentally concerns the regulatory framework governing colonial trade, investment, and economic development. This is clearly a matter of economic regulation and policy rather than production, exchange, or distribution per se.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to local conditions and comparative advantages. However, it also touches on S5 (identity/policy) regarding the fundamental policy framework governing colonial economies, making it somewhat distributed across systems.

explanatory_value — 4.0 / 5.0

The entity provides strong explanatory value by illuminating the structural relationship between metropolitan control and colonial economic efficiency. It helps explain Smith's mechanism whereby reducing regulatory constraints allows better resource allocation and mutual benefit, rather than merely naming a policy preference.

4.1 KiB Raw Blame History