feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,64 @@
|
||||
---
|
||||
entity_slug: original_government_manners
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T06:04:03.749573'
|
||||
overall_score: 4.0
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: The definition captures a distinct concept about persistent institutional
|
||||
characteristics, but it's somewhat vague about what specifically constitutes these
|
||||
"manners" and how they mechanistically create barriers. The connection between
|
||||
social customs and economic development patterns could be more precisely articulated.
|
||||
- name: source_grounding
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This appears well-grounded in Smith's analysis of European economic development
|
||||
in Book III, Chapter 1, where he discusses how historical governmental structures
|
||||
influenced economic patterns. The concept of institutional persistence affecting
|
||||
natural economic progression aligns with Smith's historical analysis.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: '"Regulation" is the correct domain placement, as this entity deals with
|
||||
governmental structures and institutional frameworks that regulate economic activity.
|
||||
The focus on governmental manners and their constraining effects on economic development
|
||||
clearly falls within regulatory concerns.'
|
||||
- name: vsm_relevance
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps well to S5 (identity/policy) as it concerns the fundamental
|
||||
governmental identity and policy frameworks that persist over time and shape systemic
|
||||
behavior. It also has relevance to S3 (internal regulation) in terms of how these
|
||||
institutional patterns regulate economic development.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The entity provides genuine explanatory power by identifying institutional
|
||||
persistence as a mechanism that explains why European economic development diverged
|
||||
from Smith's "natural" progression. It illuminates how historical path dependence
|
||||
creates structural constraints on economic development patterns.
|
||||
---
|
||||
|
||||
# Evaluation: Original Government Manners
|
||||
|
||||
## definition_precision — 3.0 / 5.0
|
||||
|
||||
The definition captures a distinct concept about persistent institutional characteristics, but it's somewhat vague about what specifically constitutes these "manners" and how they mechanistically create barriers. The connection between social customs and economic development patterns could be more precisely articulated.
|
||||
|
||||
## source_grounding — 4.0 / 5.0
|
||||
|
||||
This appears well-grounded in Smith's analysis of European economic development in Book III, Chapter 1, where he discusses how historical governmental structures influenced economic patterns. The concept of institutional persistence affecting natural economic progression aligns with Smith's historical analysis.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
"Regulation" is the correct domain placement, as this entity deals with governmental structures and institutional frameworks that regulate economic activity. The focus on governmental manners and their constraining effects on economic development clearly falls within regulatory concerns.
|
||||
|
||||
## vsm_relevance — 4.0 / 5.0
|
||||
|
||||
This entity maps well to S5 (identity/policy) as it concerns the fundamental governmental identity and policy frameworks that persist over time and shape systemic behavior. It also has relevance to S3 (internal regulation) in terms of how these institutional patterns regulate economic development.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
The entity provides genuine explanatory power by identifying institutional persistence as a mechanism that explains why European economic development diverged from Smith's "natural" progression. It illuminates how historical path dependence creates structural constraints on economic development patterns.
|
||||
Reference in New Issue
Block a user