Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

artificial_grasses

null

2026-02-23T00:35:29.604161

1.0

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without any definitional content, this entity fails to establish what "artificial grasses" means in the context of "The Wealth of Nations."

name	value	max_value	rationale
source_grounding	1.0	5.0	With no source chapter specified and no contextual information provided, there is no evidence this entity is grounded in Smith's actual text. The term "artificial grasses" seems unlikely to appear prominently in 18th-century economic discourse without significant explanation.

name	value	max_value	rationale
domain_placement	1.0	5.0	The domain is unspecified, and without definition or context, it's impossible to determine what economic or thematic category this entity should occupy. The entity provides no basis for assessing appropriate conceptual placement.

name	value	max_value	rationale
vsm_relevance	1.0	5.0	Without any definition, context, or domain specification, there is no way to map this entity to any VSM system (S1-S5). The complete absence of substantive content makes VSM placement impossible to evaluate.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An entity with no definition, context, or clear connection to the source material provides zero explanatory power. It neither illuminates economic mechanisms nor clarifies structural relations within Smith's framework.

Evaluation: Artificial Grasses

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without any definitional content, this entity fails to establish what "artificial grasses" means in the context of "The Wealth of Nations."

source_grounding — 1.0 / 5.0

With no source chapter specified and no contextual information provided, there is no evidence this entity is grounded in Smith's actual text. The term "artificial grasses" seems unlikely to appear prominently in 18th-century economic discourse without significant explanation.

domain_placement — 1.0 / 5.0

The domain is unspecified, and without definition or context, it's impossible to determine what economic or thematic category this entity should occupy. The entity provides no basis for assessing appropriate conceptual placement.

vsm_relevance — 1.0 / 5.0

Without any definition, context, or domain specification, there is no way to map this entity to any VSM system (S1-S5). The complete absence of substantive content makes VSM placement impossible to evaluate.

explanatory_value — 1.0 / 5.0

An entity with no definition, context, or clear connection to the source material provides zero explanatory power. It neither illuminates economic mechanisms nor clarifies structural relations within Smith's framework.

3.0 KiB Raw Blame History