feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: colonial_economic_system_dynamics
evaluator: null
evaluated_at: '2026-02-23T04:48:12.012301'
overall_score: 3.2
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept about economic change patterns
in colonies, but uses somewhat vague terms like "patterns of change" and "adjustment
processes" that could be more precisely specified. The connection to policy design
adds clarity but doesn't fully resolve the conceptual boundaries.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity appears well-grounded in Smith's actual analysis of colonial
development in Book IV, Chapter 7, where he does examine how colonial economies
develop over time and how monopoly policies interfere with natural growth patterns.
The framing aligns with Smith's systematic approach to understanding economic
development trajectories.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is appropriate since this entity deals with broad patterns
of economic development rather than specific mechanisms or institutions. The concept
spans multiple aspects of colonial economics and represents a higher-level analytical
framework consistent with theoretical domain placement.'
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This entity is too abstract and meta-analytical to map naturally to specific
VSM systems - it describes patterns across systems rather than functioning within
them. While colonial economies themselves could be analyzed through VSM, the concept
of "dynamics" sits above the operational level where VSM systems function.
- name: explanatory_value
value: 3.0
max_value: 5.0
rationale: The entity provides moderate explanatory value by highlighting that colonial
development follows predictable patterns that can inform policy, but it remains
somewhat descriptive rather than revealing deep causal mechanisms. It identifies
an important analytical perspective without fully illuminating the underlying
structural relations that drive these dynamics.
---
# Evaluation: Colonial Economic System Dynamics
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept about economic change patterns in colonies, but uses somewhat vague terms like "patterns of change" and "adjustment processes" that could be more precisely specified. The connection to policy design adds clarity but doesn't fully resolve the conceptual boundaries.
## source_grounding — 4.0 / 5.0
This entity appears well-grounded in Smith's actual analysis of colonial development in Book IV, Chapter 7, where he does examine how colonial economies develop over time and how monopoly policies interfere with natural growth patterns. The framing aligns with Smith's systematic approach to understanding economic development trajectories.
## domain_placement — 4.0 / 5.0
"General Theory" is appropriate since this entity deals with broad patterns of economic development rather than specific mechanisms or institutions. The concept spans multiple aspects of colonial economics and represents a higher-level analytical framework consistent with theoretical domain placement.
## vsm_relevance — 2.0 / 5.0
This entity is too abstract and meta-analytical to map naturally to specific VSM systems - it describes patterns across systems rather than functioning within them. While colonial economies themselves could be analyzed through VSM, the concept of "dynamics" sits above the operational level where VSM systems function.
## explanatory_value — 3.0 / 5.0
The entity provides moderate explanatory value by highlighting that colonial development follows predictable patterns that can inform policy, but it remains somewhat descriptive rather than revealing deep causal mechanisms. It identifies an important analytical perspective without fully illuminating the underlying structural relations that drive these dynamics.