Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

systemic_stability

null

2026-02-23T06:28:48.958997

1.2

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making this entity completely imprecise. Without any definitional content, it's impossible to assess whether the concept is distinct or merely a vague umbrella term.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no definition, context, or source chapter specified, there's no evidence this entity is grounded in Smith's actual text. The term "systemic stability" appears to be a modern analytical overlay rather than a concept Smith explicitly discussed.

name	value	max_value	rationale
domain_placement	1.0	5.0	The domain is listed as "unspecified," indicating no clear economic or thematic categorization has been established. Without definition or context, proper domain placement is impossible to assess or correct.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	While "systemic stability" could theoretically relate to VSM concepts (particularly S2's anti-oscillation function or S3's regulatory role), the complete lack of definition makes any VSM mapping purely speculative. The term is too abstract and undefined to meaningfully place within the VSM framework.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An undefined entity provides zero explanatory power and illuminates no mechanisms or structural relations. Without content, it cannot distinguish between genuine systemic mechanisms and surface-level naming of phenomena.

Evaluation: Systemic Stability

definition_precision — 1.0 / 5.0

There is no definition provided at all, making this entity completely imprecise. Without any definitional content, it's impossible to assess whether the concept is distinct or merely a vague umbrella term.

source_grounding — 1.0 / 5.0

With no definition, context, or source chapter specified, there's no evidence this entity is grounded in Smith's actual text. The term "systemic stability" appears to be a modern analytical overlay rather than a concept Smith explicitly discussed.

domain_placement — 1.0 / 5.0

The domain is listed as "unspecified," indicating no clear economic or thematic categorization has been established. Without definition or context, proper domain placement is impossible to assess or correct.

vsm_relevance — 2.0 / 5.0

While "systemic stability" could theoretically relate to VSM concepts (particularly S2's anti-oscillation function or S3's regulatory role), the complete lack of definition makes any VSM mapping purely speculative. The term is too abstract and undefined to meaningfully place within the VSM framework.

explanatory_value — 1.0 / 5.0

An undefined entity provides zero explanatory power and illuminates no mechanisms or structural relations. Without content, it cannot distinguish between genuine systemic mechanisms and surface-level naming of phenomena.

3.0 KiB Raw Blame History