Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_system_relationship

null

2026-02-23T04:55:41.102837

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept about colonial-metropolitan economic relationships, but it's somewhat vague in describing what constitutes "mutual benefit" and "free trade principles." The contrast with "monopolistic control" helps clarify the concept but could be more precise about the specific mechanisms involved.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's actual analysis in Book V, Chapter 3, where he extensively critiques the mercantile system's approach to colonial management and advocates for freer trade relationships. Smith does explicitly argue against monopolistic colonial policies and for more mutually beneficial arrangements.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for this entity, as it fundamentally concerns trade relationships, commercial policies, and the flow of goods between different economic territories. This is clearly about exchange mechanisms rather than production, distribution, or consumption per se.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems should adapt their relationships with external environments (colonies), and potentially S5 (policy/identity) regarding fundamental policy choices about colonial governance. The strategic nature of colonial relationships fits naturally within VSM thinking.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating the structural mechanism through which Smith believes colonial relationships should operate—moving from extractive monopoly to mutual exchange. It helps explain a key component of Smith's critique of mercantilism and his alternative vision for international economic relations.

Evaluation: Colony Economic System Relationship

definition_precision — 3.0 / 5.0

The definition captures a distinct concept about colonial-metropolitan economic relationships, but it's somewhat vague in describing what constitutes "mutual benefit" and "free trade principles." The contrast with "monopolistic control" helps clarify the concept but could be more precise about the specific mechanisms involved.

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's actual analysis in Book V, Chapter 3, where he extensively critiques the mercantile system's approach to colonial management and advocates for freer trade relationships. Smith does explicitly argue against monopolistic colonial policies and for more mutually beneficial arrangements.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for this entity, as it fundamentally concerns trade relationships, commercial policies, and the flow of goods between different economic territories. This is clearly about exchange mechanisms rather than production, distribution, or consumption per se.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems should adapt their relationships with external environments (colonies), and potentially S5 (policy/identity) regarding fundamental policy choices about colonial governance. The strategic nature of colonial relationships fits naturally within VSM thinking.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating the structural mechanism through which Smith believes colonial relationships should operate—moving from extractive monopoly to mutual exchange. It helps explain a key component of Smith's critique of mercantilism and his alternative vision for international economic relations.

4.0 KiB Raw Blame History