feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: colonial_prosperity_mechanisms
evaluator: null
evaluated_at: '2026-02-23T04:51:43.102455'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies specific economic factors (abundant
cheap land, high wages, self-government, value retention) that create colonial
prosperity. While comprehensive, it could be slightly more precise about how these
factors interact mechanistically.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual analysis in Book IV, Chapter
7, where he explicitly discusses these factors as natural advantages of new settlements.
The contrast with mercantilist constraints directly reflects Smith's argumentation
in the text.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Production" is the correct domain placement since these mechanisms
fundamentally concern how colonies organize productive activities and generate
wealth. The focus on land, labor, and output retention clearly relates to production
processes rather than exchange or distribution.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: "This entity spans multiple VSM systems without clearly belonging to\
\ one\u2014it involves S1 (productive operations), S3 (internal regulation through\
\ self-government), and S4 (environmental adaptation to new territories). The\
\ multi-system nature makes VSM placement somewhat ambiguous."
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by identifying the structural
conditions that enable rapid colonial development and contrasting them with artificial
policy constraints. It illuminates why colonies naturally prosper under certain
conditions rather than merely describing prosperity as an outcome.
---
# Evaluation: Colonial Prosperity Mechanisms
## definition_precision — 4.0 / 5.0
The definition clearly identifies specific economic factors (abundant cheap land, high wages, self-government, value retention) that create colonial prosperity. While comprehensive, it could be slightly more precise about how these factors interact mechanistically.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 7, where he explicitly discusses these factors as natural advantages of new settlements. The contrast with mercantilist constraints directly reflects Smith's argumentation in the text.
## domain_placement — 5.0 / 5.0
"Production" is the correct domain placement since these mechanisms fundamentally concern how colonies organize productive activities and generate wealth. The focus on land, labor, and output retention clearly relates to production processes rather than exchange or distribution.
## vsm_relevance — 3.0 / 5.0
This entity spans multiple VSM systems without clearly belonging to one—it involves S1 (productive operations), S3 (internal regulation through self-government), and S4 (environmental adaptation to new territories). The multi-system nature makes VSM placement somewhat ambiguous.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by identifying the structural conditions that enable rapid colonial development and contrasting them with artificial policy constraints. It illuminates why colonies naturally prosper under certain conditions rather than merely describing prosperity as an outcome.