feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: colony_economic_system_evolution
evaluator: null
evaluated_at: '2026-02-23T04:54:01.727708'
overall_score: 3.2
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept about colonial economic development
over time, but uses somewhat vague terms like "predictable patterns" and "various
stages" without specifying what these actually entail. It's non-circular but could
be more precise about the specific transformations involved.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does indeed discuss colonial economic development in Book V, Chapter
3, tracing how colonies evolve from initial settlements to more sophisticated
economic systems. The entity accurately reflects his analysis of colonial economic
progression, though it generalizes his observations into a broader evolutionary
framework.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: Placement in the "Accumulation" domain is appropriate since colonial
economic evolution fundamentally concerns how wealth and capital accumulate and
transform over time in colonial contexts. This aligns well with Smith's broader
themes about economic development and capital formation.
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This entity is too abstract and historical to map clearly to specific
VSM systems - it describes a meta-process of systemic change rather than operational
functions. While it might relate to S4 (adaptation) in a very general sense, it
doesn't naturally fit the VSM framework's operational focus.
- name: explanatory_value
value: 3.0
max_value: 5.0
rationale: The entity provides moderate explanatory value by highlighting that colonial
economies follow developmental patterns rather than being static, but it remains
somewhat descriptive rather than revealing specific causal mechanisms. It names
an important phenomenon but doesn't deeply illuminate the underlying structural
relations driving the evolution.
---
# Evaluation: Colony Economic System Evolution
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept about colonial economic development over time, but uses somewhat vague terms like "predictable patterns" and "various stages" without specifying what these actually entail. It's non-circular but could be more precise about the specific transformations involved.
## source_grounding — 4.0 / 5.0
Smith does indeed discuss colonial economic development in Book V, Chapter 3, tracing how colonies evolve from initial settlements to more sophisticated economic systems. The entity accurately reflects his analysis of colonial economic progression, though it generalizes his observations into a broader evolutionary framework.
## domain_placement — 4.0 / 5.0
Placement in the "Accumulation" domain is appropriate since colonial economic evolution fundamentally concerns how wealth and capital accumulate and transform over time in colonial contexts. This aligns well with Smith's broader themes about economic development and capital formation.
## vsm_relevance — 2.0 / 5.0
This entity is too abstract and historical to map clearly to specific VSM systems - it describes a meta-process of systemic change rather than operational functions. While it might relate to S4 (adaptation) in a very general sense, it doesn't naturally fit the VSM framework's operational focus.
## explanatory_value — 3.0 / 5.0
The entity provides moderate explanatory value by highlighting that colonial economies follow developmental patterns rather than being static, but it remains somewhat descriptive rather than revealing specific causal mechanisms. It names an important phenomenon but doesn't deeply illuminate the underlying structural relations driving the evolution.