Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

environmental_scanning

null

2026-02-23T05:23:43.182855

1.2

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails to establish what concept it represents.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no source chapter specified and no definition or context provided, there is no evidence this entity is grounded in "The Wealth of Nations" text. The term "environmental scanning" appears to be a modern business/management concept unlikely to appear in Smith's 1776 work.

name	value	max_value	rationale
domain_placement	1.0	5.0	The domain is unspecified, and without definition or context, it's impossible to assess whether the entity belongs in any particular economic or thematic category. The lack of domain assignment suggests poor conceptual organization.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	While "environmental scanning" as a general concept could theoretically relate to S4 (intelligence/environmental adaptation) in the VSM, the complete absence of definition and context makes any VSM mapping purely speculative rather than substantive.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An entity with no definition, context, or source grounding provides zero explanatory value. It neither illuminates mechanisms nor clarifies structural relations, functioning merely as an empty label.

Evaluation: Environmental Scanning

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails to establish what concept it represents.

source_grounding — 1.0 / 5.0

With no source chapter specified and no definition or context provided, there is no evidence this entity is grounded in "The Wealth of Nations" text. The term "environmental scanning" appears to be a modern business/management concept unlikely to appear in Smith's 1776 work.

domain_placement — 1.0 / 5.0

The domain is unspecified, and without definition or context, it's impossible to assess whether the entity belongs in any particular economic or thematic category. The lack of domain assignment suggests poor conceptual organization.

vsm_relevance — 2.0 / 5.0

While "environmental scanning" as a general concept could theoretically relate to S4 (intelligence/environmental adaptation) in the VSM, the complete absence of definition and context makes any VSM mapping purely speculative rather than substantive.

explanatory_value — 1.0 / 5.0

An entity with no definition, context, or source grounding provides zero explanatory value. It neither illuminates mechanisms nor clarifies structural relations, functioning merely as an empty label.

3.0 KiB Raw Blame History