Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_legitimacy

null

2026-02-23T05:18:23.954429

3.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a recognizable concept about social acceptance of economic systems, but it's somewhat broad and could apply to many institutional arrangements. While not circular, it lacks the precision to clearly distinguish this from related concepts like political authority or social contract.

name	value	max_value	rationale
source_grounding	2.0	5.0	The entity extrapolates significantly from Smith's brief mention of political economy being a science for statesmen and legislators. Smith doesn't explicitly discuss "legitimacy" as a distinct concept, and this appears to impose modern political science terminology onto his work.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate since legitimacy would be a foundational concern underlying economic arrangements rather than belonging to a specific economic domain. The placement correctly recognizes this as a meta-level concept about economic systems generally.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S5 (identity/policy) as legitimacy is fundamentally about the system's identity and the acceptance of its governing principles by stakeholders. It could also relate to S4 in terms of environmental adaptation to social expectations.

name	value	max_value	rationale
explanatory_value	2.0	5.0	While legitimacy is important for understanding economic systems, this entity doesn't illuminate specific mechanisms or structural relations that Smith analyzes. It names a general condition rather than explaining how economic processes actually work or interact.

Evaluation: Economic System Legitimacy

definition_precision — 3.0 / 5.0

The definition captures a recognizable concept about social acceptance of economic systems, but it's somewhat broad and could apply to many institutional arrangements. While not circular, it lacks the precision to clearly distinguish this from related concepts like political authority or social contract.

source_grounding — 2.0 / 5.0

The entity extrapolates significantly from Smith's brief mention of political economy being a science for statesmen and legislators. Smith doesn't explicitly discuss "legitimacy" as a distinct concept, and this appears to impose modern political science terminology onto his work.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate since legitimacy would be a foundational concern underlying economic arrangements rather than belonging to a specific economic domain. The placement correctly recognizes this as a meta-level concept about economic systems generally.

vsm_relevance — 4.0 / 5.0

This entity maps well to S5 (identity/policy) as legitimacy is fundamentally about the system's identity and the acceptance of its governing principles by stakeholders. It could also relate to S4 in terms of environmental adaptation to social expectations.

explanatory_value — 2.0 / 5.0

While legitimacy is important for understanding economic systems, this entity doesn't illuminate specific mechanisms or structural relations that Smith analyzes. It names a general condition rather than explaining how economic processes actually work or interact.

3.4 KiB Raw Blame History