feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,65 @@
|
||||
---
|
||||
entity_slug: colony_economic_system_governance
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T04:54:19.393706'
|
||||
overall_score: 4.0
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: The definition captures a meaningful concept but is somewhat broad, encompassing
|
||||
both "formal governmental structures and informal market mechanisms." While not
|
||||
circular, it could be more precise about what specifically constitutes these "institutional
|
||||
arrangements and decision-making processes."
|
||||
- name: source_grounding
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is well-grounded in Smith's actual analysis in Book V, Chapter
|
||||
3, where he extensively discusses colonial governance and critiques excessive
|
||||
central control over colonial economic activity. The concept directly reflects
|
||||
Smith's examination of how different governance approaches affect colonial economic
|
||||
development.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Regulation" domain is perfectly appropriate for this entity, as
|
||||
it deals with the institutional and governmental frameworks that regulate economic
|
||||
activity in colonies. This is clearly a regulatory rather than production, exchange,
|
||||
or distribution concept.
|
||||
- name: vsm_relevance
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps well to multiple VSM systems, particularly S3 (internal
|
||||
regulation/audit) for the governance mechanisms and S5 (identity/policy) for the
|
||||
overarching institutional frameworks. It represents the regulatory and policy-setting
|
||||
functions that Smith analyzes in colonial contexts.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The entity provides genuine explanatory power by illuminating Smith's
|
||||
key insight about the tension between centralized control and market mechanisms
|
||||
in colonial governance. It captures an important structural relationship that
|
||||
Smith uses to explain colonial economic performance.
|
||||
---
|
||||
|
||||
# Evaluation: Colony Economic System Governance
|
||||
|
||||
## definition_precision — 3.0 / 5.0
|
||||
|
||||
The definition captures a meaningful concept but is somewhat broad, encompassing both "formal governmental structures and informal market mechanisms." While not circular, it could be more precise about what specifically constitutes these "institutional arrangements and decision-making processes."
|
||||
|
||||
## source_grounding — 4.0 / 5.0
|
||||
|
||||
This entity is well-grounded in Smith's actual analysis in Book V, Chapter 3, where he extensively discusses colonial governance and critiques excessive central control over colonial economic activity. The concept directly reflects Smith's examination of how different governance approaches affect colonial economic development.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Regulation" domain is perfectly appropriate for this entity, as it deals with the institutional and governmental frameworks that regulate economic activity in colonies. This is clearly a regulatory rather than production, exchange, or distribution concept.
|
||||
|
||||
## vsm_relevance — 4.0 / 5.0
|
||||
|
||||
This entity maps well to multiple VSM systems, particularly S3 (internal regulation/audit) for the governance mechanisms and S5 (identity/policy) for the overarching institutional frameworks. It represents the regulatory and policy-setting functions that Smith analyzes in colonial contexts.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
The entity provides genuine explanatory power by illuminating Smith's key insight about the tension between centralized control and market mechanisms in colonial governance. It captures an important structural relationship that Smith uses to explain colonial economic performance.
|
||||
Reference in New Issue
Block a user