feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: economic_system_legitimacy
evaluator: null
evaluated_at: '2026-02-23T05:18:23.954429'
overall_score: 3.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a recognizable concept about social acceptance
of economic systems, but it's somewhat broad and could apply to many institutional
arrangements. While not circular, it lacks the precision to clearly distinguish
this from related concepts like political authority or social contract.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: The entity extrapolates significantly from Smith's brief mention of political
economy being a science for statesmen and legislators. Smith doesn't explicitly
discuss "legitimacy" as a distinct concept, and this appears to impose modern
political science terminology onto his work.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is appropriate since legitimacy would be a foundational
concern underlying economic arrangements rather than belonging to a specific economic
domain. The placement correctly recognizes this as a meta-level concept about
economic systems generally.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S5 (identity/policy) as legitimacy is fundamentally
about the system's identity and the acceptance of its governing principles by
stakeholders. It could also relate to S4 in terms of environmental adaptation
to social expectations.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: While legitimacy is important for understanding economic systems, this
entity doesn't illuminate specific mechanisms or structural relations that Smith
analyzes. It names a general condition rather than explaining how economic processes
actually work or interact.
---
# Evaluation: Economic System Legitimacy
## definition_precision — 3.0 / 5.0
The definition captures a recognizable concept about social acceptance of economic systems, but it's somewhat broad and could apply to many institutional arrangements. While not circular, it lacks the precision to clearly distinguish this from related concepts like political authority or social contract.
## source_grounding — 2.0 / 5.0
The entity extrapolates significantly from Smith's brief mention of political economy being a science for statesmen and legislators. Smith doesn't explicitly discuss "legitimacy" as a distinct concept, and this appears to impose modern political science terminology onto his work.
## domain_placement — 4.0 / 5.0
"General Theory" is appropriate since legitimacy would be a foundational concern underlying economic arrangements rather than belonging to a specific economic domain. The placement correctly recognizes this as a meta-level concept about economic systems generally.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S5 (identity/policy) as legitimacy is fundamentally about the system's identity and the acceptance of its governing principles by stakeholders. It could also relate to S4 in terms of environmental adaptation to social expectations.
## explanatory_value — 2.0 / 5.0
While legitimacy is important for understanding economic systems, this entity doesn't illuminate specific mechanisms or structural relations that Smith analyzes. It names a general condition rather than explaining how economic processes actually work or interact.