feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,61 @@
---
entity_slug: agricultural_improvement_foundation
evaluator: null
evaluated_at: '2026-02-23T00:27:12.354028'
overall_score: 1.2
scores:
- name: definition_precision
value: 1.0
max_value: 5.0
rationale: There is no definition provided at all, making it impossible to assess
precision or distinctness. Without any definitional content, this entity fails
completely on precision criteria.
- name: source_grounding
value: 1.0
max_value: 5.0
rationale: With no source chapter specified and no definition or context provided,
there is no evidence this entity is grounded in Smith's actual text. The term
"Agricultural Improvement Foundation" sounds like a modern institutional concept
that likely doesn't appear in The Wealth of Nations.
- name: domain_placement
value: 2.0
max_value: 5.0
rationale: While agriculture is certainly relevant to The Wealth of Nations, the
specific framing as a "foundation" (suggesting a modern organizational form) seems
anachronistic. The domain assignment cannot be properly evaluated without more
context about what this entity actually represents.
- name: vsm_relevance
value: 1.0
max_value: 5.0
rationale: Without any definition or context, it's impossible to determine which
VSM system this entity might relate to. The entity provides no information about
its function, structure, or role that would enable VSM mapping.
- name: explanatory_value
value: 1.0
max_value: 5.0
rationale: An undefined entity with no context or source grounding provides zero
explanatory value. It neither illuminates mechanisms nor clarifies structural
relations within Smith's economic framework.
---
# Evaluation: Agricultural Improvement Foundation
## definition_precision — 1.0 / 5.0
There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails completely on precision criteria.
## source_grounding — 1.0 / 5.0
With no source chapter specified and no definition or context provided, there is no evidence this entity is grounded in Smith's actual text. The term "Agricultural Improvement Foundation" sounds like a modern institutional concept that likely doesn't appear in The Wealth of Nations.
## domain_placement — 2.0 / 5.0
While agriculture is certainly relevant to The Wealth of Nations, the specific framing as a "foundation" (suggesting a modern organizational form) seems anachronistic. The domain assignment cannot be properly evaluated without more context about what this entity actually represents.
## vsm_relevance — 1.0 / 5.0
Without any definition or context, it's impossible to determine which VSM system this entity might relate to. The entity provides no information about its function, structure, or role that would enable VSM mapping.
## explanatory_value — 1.0 / 5.0
An undefined entity with no context or source grounding provides zero explanatory value. It neither illuminates mechanisms nor clarifies structural relations within Smith's economic framework.