feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: colonial_economic_system_governance
evaluator: null
evaluated_at: '2026-02-23T04:48:55.734243'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes governance structures from the economic
policies themselves, focusing on the "how" of policy-making and administration.
It avoids circularity and identifies specific components (legislative bodies,
administrative agencies, enforcement mechanisms).
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does analyze colonial governance structures in Book IV, Chapter
7, particularly critiquing monopoly-based systems and their governance failures.
The entity accurately reflects his arguments about accountability deficits and
the potential benefits of more open, participatory arrangements.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain placement since this entity concerns
the institutional mechanisms that create and enforce economic rules rather than
the substantive policies themselves. It sits at the intersection of institutional
design and regulatory implementation.'
- name: vsm_relevance
value: 5.0
max_value: 5.0
rationale: This entity maps clearly to S3 (internal regulation/audit) as it deals
with governance structures that monitor and control economic operations. It also
has connections to S5 (identity/policy) regarding how colonial systems establish
and maintain their governing frameworks.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: "The entity illuminates an important structural mechanism\u2014how the\
\ quality of governance institutions affects economic outcomes in colonial systems.\
\ It provides analytical leverage for understanding why some colonial arrangements\
\ succeed while others fail, beyond just examining their policies."
---
# Evaluation: Colonial Economic System Governance
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes governance structures from the economic policies themselves, focusing on the "how" of policy-making and administration. It avoids circularity and identifies specific components (legislative bodies, administrative agencies, enforcement mechanisms).
## source_grounding — 4.0 / 5.0
Smith does analyze colonial governance structures in Book IV, Chapter 7, particularly critiquing monopoly-based systems and their governance failures. The entity accurately reflects his arguments about accountability deficits and the potential benefits of more open, participatory arrangements.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain placement since this entity concerns the institutional mechanisms that create and enforce economic rules rather than the substantive policies themselves. It sits at the intersection of institutional design and regulatory implementation.
## vsm_relevance — 5.0 / 5.0
This entity maps clearly to S3 (internal regulation/audit) as it deals with governance structures that monitor and control economic operations. It also has connections to S5 (identity/policy) regarding how colonial systems establish and maintain their governing frameworks.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important structural mechanism—how the quality of governance institutions affects economic outcomes in colonial systems. It provides analytical leverage for understanding why some colonial arrangements succeed while others fail, beyond just examining their policies.