feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: colony_economic_system_equilibrium
evaluator: null
evaluated_at: '2026-02-23T04:53:43.843593'
overall_score: 2.6
scores:
- name: definition_precision
value: 2.0
max_value: 5.0
rationale: The definition is vague and relies on undefined terms like "stable state,"
"naturally tend," and "balanced growth" without specifying what constitutes equilibrium
or how it's measured. It reads more like a general economic principle than a precise,
operationalizable concept.
- name: source_grounding
value: 3.0
max_value: 5.0
rationale: While Smith does discuss colonial economies and their natural development,
the specific framing of a "stable equilibrium state" with "balanced growth across
sectors" appears to impose modern equilibrium theory concepts that may not reflect
Smith's actual analytical framework. The general idea of natural development is
present, but the equilibrium terminology seems anachronistic.
- name: domain_placement
value: 2.0
max_value: 5.0
rationale: '"Accumulation" seems like a poor fit for what is described as a systemic
equilibrium state. This concept appears more related to systemic coordination
or regulation rather than the process of capital accumulation per se.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to VSM System 3 (internal regulation) as it describes
the self-regulating tendency of colonial economic systems to achieve balance.
It could also relate to S2 (coordination) in terms of how different sectors coordinate
naturally.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity names a phenomenon (tendency toward equilibrium) but doesn't
illuminate the specific mechanisms by which colonial economies achieve this balance
or what structural relations enable it. It remains at a high level of abstraction
without explanatory depth.
---
# Evaluation: Colony Economic System Equilibrium
## definition_precision — 2.0 / 5.0
The definition is vague and relies on undefined terms like "stable state," "naturally tend," and "balanced growth" without specifying what constitutes equilibrium or how it's measured. It reads more like a general economic principle than a precise, operationalizable concept.
## source_grounding — 3.0 / 5.0
While Smith does discuss colonial economies and their natural development, the specific framing of a "stable equilibrium state" with "balanced growth across sectors" appears to impose modern equilibrium theory concepts that may not reflect Smith's actual analytical framework. The general idea of natural development is present, but the equilibrium terminology seems anachronistic.
## domain_placement — 2.0 / 5.0
"Accumulation" seems like a poor fit for what is described as a systemic equilibrium state. This concept appears more related to systemic coordination or regulation rather than the process of capital accumulation per se.
## vsm_relevance — 4.0 / 5.0
This entity maps well to VSM System 3 (internal regulation) as it describes the self-regulating tendency of colonial economic systems to achieve balance. It could also relate to S2 (coordination) in terms of how different sectors coordinate naturally.
## explanatory_value — 2.0 / 5.0
The entity names a phenomenon (tendency toward equilibrium) but doesn't illuminate the specific mechanisms by which colonial economies achieve this balance or what structural relations enable it. It remains at a high level of abstraction without explanatory depth.