Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_policy_alternatives

null

2026-02-23T04:46:44.001592

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept about different approaches to colonial economic management, but it remains somewhat vague with phrases like "varying degrees of economic freedom" without specifying what these alternatives actually entail. It avoids circularity but lacks the precision needed to clearly distinguish between different policy options.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity appears well-grounded in Smith's actual discussion in Book IV, Chapter 7, where he explicitly examines different approaches to colonial policy and critiques the monopoly system. The concept directly reflects Smith's comparative analysis of policy alternatives rather than imposing external frameworks.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate, as this entity deals specifically with different regulatory approaches and policy frameworks for managing colonial economic relationships. This is fundamentally about regulatory choices rather than market mechanisms or production processes.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents different strategic approaches to managing colonial relationships based on environmental feedback and learning. It also has relevance to S5 (identity/policy) as these alternatives reflect different policy philosophies about the proper relationship between mother country and colonies.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory value by highlighting that Smith's critique of mercantilism includes constructive alternatives, not just criticism. It illuminates the structural relationship between policy choice and economic outcomes, showing how different regulatory approaches can produce different systemic results.

Evaluation: Colonial Economic Policy Alternatives

definition_precision — 3.0 / 5.0

The definition captures a distinct concept about different approaches to colonial economic management, but it remains somewhat vague with phrases like "varying degrees of economic freedom" without specifying what these alternatives actually entail. It avoids circularity but lacks the precision needed to clearly distinguish between different policy options.

source_grounding — 4.0 / 5.0

This entity appears well-grounded in Smith's actual discussion in Book IV, Chapter 7, where he explicitly examines different approaches to colonial policy and critiques the monopoly system. The concept directly reflects Smith's comparative analysis of policy alternatives rather than imposing external frameworks.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate, as this entity deals specifically with different regulatory approaches and policy frameworks for managing colonial economic relationships. This is fundamentally about regulatory choices rather than market mechanisms or production processes.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents different strategic approaches to managing colonial relationships based on environmental feedback and learning. It also has relevance to S5 (identity/policy) as these alternatives reflect different policy philosophies about the proper relationship between mother country and colonies.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory value by highlighting that Smith's critique of mercantilism includes constructive alternatives, not just criticism. It illuminates the structural relationship between policy choice and economic outcomes, showing how different regulatory approaches can produce different systemic results.

4.0 KiB Raw Blame History