Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

policy_closure

null

2026-02-23T06:06:43.701247

1.2

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without any definitional content, this entity fails to establish what "policy closure" means or how it differs from related concepts.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no definition, context, or source chapter specified, there is no evidence this entity is grounded in Smith's actual text. The term "policy closure" does not appear to be terminology that Smith himself would have used in The Wealth of Nations.

name	value	max_value	rationale
domain_placement	1.0	5.0	The domain is listed as "unspecified," providing no guidance on thematic or economic categorization. Without knowing what policy closure refers to, it's impossible to assess whether it belongs in trade, labor, capital, or another economic domain.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	The term "policy" suggests potential relevance to S5 (identity/policy) in the VSM framework, but without a definition, the nature of "closure" and its systemic function remains unclear. This prevents meaningful VSM mapping beyond superficial keyword matching.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An undefined entity provides zero explanatory power and illuminates no mechanisms or structural relations. Without content, it cannot contribute to understanding either Smith's economic theory or its VSM interpretation.

Evaluation: Policy Closure

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without any definitional content, this entity fails to establish what "policy closure" means or how it differs from related concepts.

source_grounding — 1.0 / 5.0

With no definition, context, or source chapter specified, there is no evidence this entity is grounded in Smith's actual text. The term "policy closure" does not appear to be terminology that Smith himself would have used in The Wealth of Nations.

domain_placement — 1.0 / 5.0

The domain is listed as "unspecified," providing no guidance on thematic or economic categorization. Without knowing what policy closure refers to, it's impossible to assess whether it belongs in trade, labor, capital, or another economic domain.

vsm_relevance — 2.0 / 5.0

The term "policy" suggests potential relevance to S5 (identity/policy) in the VSM framework, but without a definition, the nature of "closure" and its systemic function remains unclear. This prevents meaningful VSM mapping beyond superficial keyword matching.

explanatory_value — 1.0 / 5.0

An undefined entity provides zero explanatory power and illuminates no mechanisms or structural relations. Without content, it cannot contribute to understanding either Smith's economic theory or its VSM interpretation.

3.1 KiB Raw Blame History