feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: economic_system_success_measure
evaluator: null
evaluated_at: '2026-02-23T05:21:12.579993'
overall_score: 3.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept about measuring economic system
performance, but it's somewhat broad and could be more precise about what constitutes
"success" versus mere measurement. The inclusion of both wealth generation and
distribution metrics adds useful specificity.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does discuss the objectives of political economy (providing
subsistence and revenue), he doesn't explicitly develop a framework for measuring
system success or performance indicators. This entity extrapolates beyond what
Smith directly addresses in the text.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is appropriate since this concept would span across
Smith''s various discussions of different economic systems and policies. It''s
meta-analytical rather than tied to specific mechanisms like trade or production.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S3 (internal regulation/audit) as it concerns
monitoring and evaluating system performance against objectives. It could also
relate to S5 (identity/policy) in terms of defining what constitutes successful
achievement of the system's purpose.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: While the concept of measuring economic success is important, this entity
doesn't illuminate specific mechanisms or structural relations that Smith explores.
It's more of a meta-concept that names the need for evaluation rather than explaining
how economic systems actually function.
---
# Evaluation: Economic System Success Measure
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept about measuring economic system performance, but it's somewhat broad and could be more precise about what constitutes "success" versus mere measurement. The inclusion of both wealth generation and distribution metrics adds useful specificity.
## source_grounding — 2.0 / 5.0
While Smith does discuss the objectives of political economy (providing subsistence and revenue), he doesn't explicitly develop a framework for measuring system success or performance indicators. This entity extrapolates beyond what Smith directly addresses in the text.
## domain_placement — 4.0 / 5.0
"General Theory" is appropriate since this concept would span across Smith's various discussions of different economic systems and policies. It's meta-analytical rather than tied to specific mechanisms like trade or production.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S3 (internal regulation/audit) as it concerns monitoring and evaluating system performance against objectives. It could also relate to S5 (identity/policy) in terms of defining what constitutes successful achievement of the system's purpose.
## explanatory_value — 2.0 / 5.0
While the concept of measuring economic success is important, this entity doesn't illuminate specific mechanisms or structural relations that Smith explores. It's more of a meta-concept that names the need for evaluation rather than explaining how economic systems actually function.