Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

planter_independence

null

2026-02-23T06:06:08.810881

1.2

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without any definitional content, this entity fails to establish what "planter independence" actually means in the context of The Wealth of Nations.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no definition, context, or source chapter specified, there is no evidence this entity is grounded in Smith's actual text. The term "planter independence" could refer to colonial plantation owners' autonomy, but without textual anchoring, this appears to be an unsubstantiated concept.

name	value	max_value	rationale
domain_placement	1.0	5.0	The domain is listed as "unspecified," providing no basis for evaluating whether the entity belongs in the correct conceptual category. Without knowing the intended economic or thematic domain, proper placement cannot be assessed.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	While "independence" could potentially relate to VSM concepts of autonomy (S1 operations) or policy-making (S5), the complete lack of definition makes any VSM mapping purely speculative. The entity is too undefined to meaningfully connect to viable system principles.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An entity without definition, context, or source grounding provides zero explanatory power about economic mechanisms or structural relations in Smith's work. It names a potential phenomenon but illuminates nothing about how it functions or relates to other concepts.

Evaluation: Planter Independence

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without any definitional content, this entity fails to establish what "planter independence" actually means in the context of The Wealth of Nations.

source_grounding — 1.0 / 5.0

With no definition, context, or source chapter specified, there is no evidence this entity is grounded in Smith's actual text. The term "planter independence" could refer to colonial plantation owners' autonomy, but without textual anchoring, this appears to be an unsubstantiated concept.

domain_placement — 1.0 / 5.0

The domain is listed as "unspecified," providing no basis for evaluating whether the entity belongs in the correct conceptual category. Without knowing the intended economic or thematic domain, proper placement cannot be assessed.

vsm_relevance — 2.0 / 5.0

While "independence" could potentially relate to VSM concepts of autonomy (S1 operations) or policy-making (S5), the complete lack of definition makes any VSM mapping purely speculative. The entity is too undefined to meaningfully connect to viable system principles.

explanatory_value — 1.0 / 5.0

An entity without definition, context, or source grounding provides zero explanatory power about economic mechanisms or structural relations in Smith's work. It names a potential phenomenon but illuminates nothing about how it functions or relates to other concepts.

3.3 KiB Raw Blame History