Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_prosperity_mechanisms

null

2026-02-23T04:51:43.102455

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies specific economic factors (abundant cheap land, high wages, self-government, value retention) that create colonial prosperity. While comprehensive, it could be slightly more precise about how these factors interact mechanistically.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 7, where he explicitly discusses these factors as natural advantages of new settlements. The contrast with mercantilist constraints directly reflects Smith's argumentation in the text.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain placement since these mechanisms fundamentally concern how colonies organize productive activities and generate wealth. The focus on land, labor, and output retention clearly relates to production processes rather than exchange or distribution.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity spans multiple VSM systems without clearly belonging to one—it involves S1 (productive operations), S3 (internal regulation through self-government), and S4 (environmental adaptation to new territories). The multi-system nature makes VSM placement somewhat ambiguous.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by identifying the structural conditions that enable rapid colonial development and contrasting them with artificial policy constraints. It illuminates why colonies naturally prosper under certain conditions rather than merely describing prosperity as an outcome.

Evaluation: Colonial Prosperity Mechanisms

definition_precision — 4.0 / 5.0

The definition clearly identifies specific economic factors (abundant cheap land, high wages, self-government, value retention) that create colonial prosperity. While comprehensive, it could be slightly more precise about how these factors interact mechanistically.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 7, where he explicitly discusses these factors as natural advantages of new settlements. The contrast with mercantilist constraints directly reflects Smith's argumentation in the text.

domain_placement — 5.0 / 5.0

"Production" is the correct domain placement since these mechanisms fundamentally concern how colonies organize productive activities and generate wealth. The focus on land, labor, and output retention clearly relates to production processes rather than exchange or distribution.

vsm_relevance — 3.0 / 5.0

This entity spans multiple VSM systems without clearly belonging to one—it involves S1 (productive operations), S3 (internal regulation through self-government), and S4 (environmental adaptation to new territories). The multi-system nature makes VSM placement somewhat ambiguous.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by identifying the structural conditions that enable rapid colonial development and contrasting them with artificial policy constraints. It illuminates why colonies naturally prosper under certain conditions rather than merely describing prosperity as an outcome.

3.5 KiB Raw Blame History