feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: colonial_economic_system_equilibrium
evaluator: null
evaluated_at: '2026-02-23T04:48:21.032719'
overall_score: 2.6
scores:
- name: definition_precision
value: 2.0
max_value: 5.0
rationale: The definition is vague and circular, using terms like "stable state,"
"naturally tend," and "balanced" without clear operational meaning. It conflates
equilibrium as an analytical concept with empirical claims about what colonial
economies actually do.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith discusses colonial trade and monopoly distortions in Book
IV, Chapter 7, he doesn't articulate a specific theory of "colonial economic system
equilibrium" as a distinct analytical concept. The entity appears to impose modern
equilibrium theory onto Smith's more descriptive analysis of colonial trade policies.
- name: domain_placement
value: 3.0
max_value: 5.0
rationale: '"General Theory" is appropriate since this attempts to describe systemic
economic behavior, though it could arguably fit in a trade or colonial policy
domain. The domain placement is reasonable but not clearly superior to alternatives.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This concept maps well to VSM System 2 (coordination/anti-oscillation)
as it describes system-wide balance and stability mechanisms. The focus on equilibrium
and the disruption of natural coordination by monopoly policies aligns with S2's
function of managing system oscillations.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity adds little explanatory power beyond restating that markets
tend toward balance when not artificially constrained. It doesn't illuminate specific
mechanisms or provide analytical tools that aren't already captured by more fundamental
concepts like market forces and monopoly distortions.
---
# Evaluation: Colonial Economic System Equilibrium
## definition_precision — 2.0 / 5.0
The definition is vague and circular, using terms like "stable state," "naturally tend," and "balanced" without clear operational meaning. It conflates equilibrium as an analytical concept with empirical claims about what colonial economies actually do.
## source_grounding — 2.0 / 5.0
While Smith discusses colonial trade and monopoly distortions in Book IV, Chapter 7, he doesn't articulate a specific theory of "colonial economic system equilibrium" as a distinct analytical concept. The entity appears to impose modern equilibrium theory onto Smith's more descriptive analysis of colonial trade policies.
## domain_placement — 3.0 / 5.0
"General Theory" is appropriate since this attempts to describe systemic economic behavior, though it could arguably fit in a trade or colonial policy domain. The domain placement is reasonable but not clearly superior to alternatives.
## vsm_relevance — 4.0 / 5.0
This concept maps well to VSM System 2 (coordination/anti-oscillation) as it describes system-wide balance and stability mechanisms. The focus on equilibrium and the disruption of natural coordination by monopoly policies aligns with S2's function of managing system oscillations.
## explanatory_value — 2.0 / 5.0
The entity adds little explanatory power beyond restating that markets tend toward balance when not artificially constrained. It doesn't illuminate specific mechanisms or provide analytical tools that aren't already captured by more fundamental concepts like market forces and monopoly distortions.