feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: colony_economic_system_governance
evaluator: null
evaluated_at: '2026-02-23T04:54:19.393706'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a meaningful concept but is somewhat broad, encompassing
both "formal governmental structures and informal market mechanisms." While not
circular, it could be more precise about what specifically constitutes these "institutional
arrangements and decision-making processes."
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual analysis in Book V, Chapter
3, where he extensively discusses colonial governance and critiques excessive
central control over colonial economic activity. The concept directly reflects
Smith's examination of how different governance approaches affect colonial economic
development.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain is perfectly appropriate for this entity, as
it deals with the institutional and governmental frameworks that regulate economic
activity in colonies. This is clearly a regulatory rather than production, exchange,
or distribution concept.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to multiple VSM systems, particularly S3 (internal
regulation/audit) for the governance mechanisms and S5 (identity/policy) for the
overarching institutional frameworks. It represents the regulatory and policy-setting
functions that Smith analyzes in colonial contexts.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by illuminating Smith's
key insight about the tension between centralized control and market mechanisms
in colonial governance. It captures an important structural relationship that
Smith uses to explain colonial economic performance.
---
# Evaluation: Colony Economic System Governance
## definition_precision — 3.0 / 5.0
The definition captures a meaningful concept but is somewhat broad, encompassing both "formal governmental structures and informal market mechanisms." While not circular, it could be more precise about what specifically constitutes these "institutional arrangements and decision-making processes."
## source_grounding — 4.0 / 5.0
This entity is well-grounded in Smith's actual analysis in Book V, Chapter 3, where he extensively discusses colonial governance and critiques excessive central control over colonial economic activity. The concept directly reflects Smith's examination of how different governance approaches affect colonial economic development.
## domain_placement — 5.0 / 5.0
The "Regulation" domain is perfectly appropriate for this entity, as it deals with the institutional and governmental frameworks that regulate economic activity in colonies. This is clearly a regulatory rather than production, exchange, or distribution concept.
## vsm_relevance — 4.0 / 5.0
This entity maps well to multiple VSM systems, particularly S3 (internal regulation/audit) for the governance mechanisms and S5 (identity/policy) for the overarching institutional frameworks. It represents the regulatory and policy-setting functions that Smith analyzes in colonial contexts.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by illuminating Smith's key insight about the tension between centralized control and market mechanisms in colonial governance. It captures an important structural relationship that Smith uses to explain colonial economic performance.