Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

kelp

null

2026-02-23T05:39:12.076846

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying kelp as a particular type of seaweed with distinct industrial uses and harvesting characteristics. It avoids circularity and captures a concrete concept rather than a vague category.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 11, where he specifically discusses kelp as an example of how natural products can command rent without human improvement. The context accurately reflects Smith's analytical purpose in using this example.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is correct, as kelp represents a natural input to production processes (glassmaking, soap production) and illustrates principles about the productive capacity of land. It fits squarely within production economics rather than exchange or distribution.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Kelp maps most naturally to S1 (primary operations) as a basic productive input, but it's somewhat VSM-neutral since it's primarily a static resource rather than a dynamic system component. It doesn't clearly illuminate VSM structural relationships.

name	value	max_value	rationale
explanatory_value	4.0	5.0	Kelp provides genuine explanatory value by illustrating the mechanism through which natural productive capacity generates rent independent of human improvement. It demonstrates an important structural principle about the relationship between natural resources and economic value creation.

Evaluation: Kelp

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying kelp as a particular type of seaweed with distinct industrial uses and harvesting characteristics. It avoids circularity and captures a concrete concept rather than a vague category.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 11, where he specifically discusses kelp as an example of how natural products can command rent without human improvement. The context accurately reflects Smith's analytical purpose in using this example.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is correct, as kelp represents a natural input to production processes (glassmaking, soap production) and illustrates principles about the productive capacity of land. It fits squarely within production economics rather than exchange or distribution.

vsm_relevance — 3.0 / 5.0

Kelp maps most naturally to S1 (primary operations) as a basic productive input, but it's somewhat VSM-neutral since it's primarily a static resource rather than a dynamic system component. It doesn't clearly illuminate VSM structural relationships.

explanatory_value — 4.0 / 5.0

Kelp provides genuine explanatory value by illustrating the mechanism through which natural productive capacity generates rent independent of human improvement. It demonstrates an important structural principle about the relationship between natural resources and economic value creation.

3.3 KiB Raw Blame History