Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_autonomy

null

2026-02-23T05:09:15.119171

1.8

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making this entity completely imprecise. Without any definitional content, it's impossible to assess whether the concept captures something distinct or is merely a vague umbrella term.

name	value	max_value	rationale
source_grounding	2.0	5.0	While "economic autonomy" could relate to Smith's discussions of individual economic freedom and self-interest, without a definition or specified source chapter, there's no way to verify this entity is grounded in actual textual content. The term itself is plausible but unsubstantiated.

name	value	max_value	rationale
domain_placement	2.0	5.0	The domain is listed as "unspecified," which is problematic for an economic concept that should clearly belong to a particular thematic category. Economic autonomy could reasonably fit in domains related to individual liberty, market mechanisms, or institutional frameworks, but without specification it's poorly placed.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Economic autonomy could potentially map to multiple VSM systems - S1 (autonomous operational units), S4 (adaptive capacity), or S5 (identity/policy autonomy) - but without a clear definition, the VSM placement remains speculative. The concept has potential VSM relevance but lacks the precision needed for confident mapping.

name	value	max_value	rationale
explanatory_value	1.0	5.0	Without any definition, context, or source grounding, this entity provides no explanatory power whatsoever. It's merely a label that could refer to various economic phenomena but illuminates no specific mechanisms or structural relations from Smith's work.

Evaluation: Economic Autonomy

definition_precision — 1.0 / 5.0

There is no definition provided at all, making this entity completely imprecise. Without any definitional content, it's impossible to assess whether the concept captures something distinct or is merely a vague umbrella term.

source_grounding — 2.0 / 5.0

While "economic autonomy" could relate to Smith's discussions of individual economic freedom and self-interest, without a definition or specified source chapter, there's no way to verify this entity is grounded in actual textual content. The term itself is plausible but unsubstantiated.

domain_placement — 2.0 / 5.0

The domain is listed as "unspecified," which is problematic for an economic concept that should clearly belong to a particular thematic category. Economic autonomy could reasonably fit in domains related to individual liberty, market mechanisms, or institutional frameworks, but without specification it's poorly placed.

vsm_relevance — 3.0 / 5.0

Economic autonomy could potentially map to multiple VSM systems - S1 (autonomous operational units), S4 (adaptive capacity), or S5 (identity/policy autonomy) - but without a clear definition, the VSM placement remains speculative. The concept has potential VSM relevance but lacks the precision needed for confident mapping.

explanatory_value — 1.0 / 5.0

Without any definition, context, or source grounding, this entity provides no explanatory power whatsoever. It's merely a label that could refer to various economic phenomena but illuminates no specific mechanisms or structural relations from Smith's work.

3.5 KiB Raw Blame History