feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: original_government_manners
evaluator: null
evaluated_at: '2026-02-23T06:04:03.749573'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a distinct concept about persistent institutional
characteristics, but it's somewhat vague about what specifically constitutes these
"manners" and how they mechanistically create barriers. The connection between
social customs and economic development patterns could be more precisely articulated.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This appears well-grounded in Smith's analysis of European economic development
in Book III, Chapter 1, where he discusses how historical governmental structures
influenced economic patterns. The concept of institutional persistence affecting
natural economic progression aligns with Smith's historical analysis.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain placement, as this entity deals with
governmental structures and institutional frameworks that regulate economic activity.
The focus on governmental manners and their constraining effects on economic development
clearly falls within regulatory concerns.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S5 (identity/policy) as it concerns the fundamental
governmental identity and policy frameworks that persist over time and shape systemic
behavior. It also has relevance to S3 (internal regulation) in terms of how these
institutional patterns regulate economic development.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by identifying institutional
persistence as a mechanism that explains why European economic development diverged
from Smith's "natural" progression. It illuminates how historical path dependence
creates structural constraints on economic development patterns.
---
# Evaluation: Original Government Manners
## definition_precision — 3.0 / 5.0
The definition captures a distinct concept about persistent institutional characteristics, but it's somewhat vague about what specifically constitutes these "manners" and how they mechanistically create barriers. The connection between social customs and economic development patterns could be more precisely articulated.
## source_grounding — 4.0 / 5.0
This appears well-grounded in Smith's analysis of European economic development in Book III, Chapter 1, where he discusses how historical governmental structures influenced economic patterns. The concept of institutional persistence affecting natural economic progression aligns with Smith's historical analysis.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain placement, as this entity deals with governmental structures and institutional frameworks that regulate economic activity. The focus on governmental manners and their constraining effects on economic development clearly falls within regulatory concerns.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S5 (identity/policy) as it concerns the fundamental governmental identity and policy frameworks that persist over time and shape systemic behavior. It also has relevance to S3 (internal regulation) in terms of how these institutional patterns regulate economic development.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by identifying institutional persistence as a mechanism that explains why European economic development diverged from Smith's "natural" progression. It illuminates how historical path dependence creates structural constraints on economic development patterns.