Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_improvement_foundation

null

2026-02-23T00:27:12.354028

1.2

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails completely on precision criteria.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no source chapter specified and no definition or context provided, there is no evidence this entity is grounded in Smith's actual text. The term "Agricultural Improvement Foundation" sounds like a modern institutional concept that likely doesn't appear in The Wealth of Nations.

name	value	max_value	rationale
domain_placement	2.0	5.0	While agriculture is certainly relevant to The Wealth of Nations, the specific framing as a "foundation" (suggesting a modern organizational form) seems anachronistic. The domain assignment cannot be properly evaluated without more context about what this entity actually represents.

name	value	max_value	rationale
vsm_relevance	1.0	5.0	Without any definition or context, it's impossible to determine which VSM system this entity might relate to. The entity provides no information about its function, structure, or role that would enable VSM mapping.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An undefined entity with no context or source grounding provides zero explanatory value. It neither illuminates mechanisms nor clarifies structural relations within Smith's economic framework.

Evaluation: Agricultural Improvement Foundation

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails completely on precision criteria.

source_grounding — 1.0 / 5.0

With no source chapter specified and no definition or context provided, there is no evidence this entity is grounded in Smith's actual text. The term "Agricultural Improvement Foundation" sounds like a modern institutional concept that likely doesn't appear in The Wealth of Nations.

domain_placement — 2.0 / 5.0

While agriculture is certainly relevant to The Wealth of Nations, the specific framing as a "foundation" (suggesting a modern organizational form) seems anachronistic. The domain assignment cannot be properly evaluated without more context about what this entity actually represents.

vsm_relevance — 1.0 / 5.0

Without any definition or context, it's impossible to determine which VSM system this entity might relate to. The entity provides no information about its function, structure, or role that would enable VSM mapping.

explanatory_value — 1.0 / 5.0

An undefined entity with no context or source grounding provides zero explanatory value. It neither illuminates mechanisms nor clarifies structural relations within Smith's economic framework.

3.0 KiB Raw Blame History