Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

wood_price

null

2026-02-23T06:39:38.341634

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes wood price as the market price of timber and firewood, with specific causal mechanisms (agriculture advancement reducing forest land leading to scarcity and price increases). It avoids circularity and captures a distinct economic phenomenon rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 11, where he explicitly discusses wood prices in relation to coal demand and examines how agricultural development affects timber scarcity. The relationship between wood and coal as alternative fuel sources is a clear theme in the source material.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is correct, as wood price relates directly to the production and supply of timber resources, and Smith analyzes it within the context of productive land use and resource allocation. This fits naturally within production economics rather than exchange or distribution.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Wood price has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it represents market signals about resource scarcity that guide economic decision-making. However, it's more of a market outcome than a systemic function, making the VSM mapping somewhat indirect.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating the mechanism of resource substitution (wood vs. coal) and how land use changes affect commodity prices. It reveals structural relationships between agricultural development, resource scarcity, and market pricing rather than merely naming a surface phenomenon.

Evaluation: Wood Price

definition_precision — 4.0 / 5.0

The definition clearly distinguishes wood price as the market price of timber and firewood, with specific causal mechanisms (agriculture advancement reducing forest land leading to scarcity and price increases). It avoids circularity and captures a distinct economic phenomenon rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 11, where he explicitly discusses wood prices in relation to coal demand and examines how agricultural development affects timber scarcity. The relationship between wood and coal as alternative fuel sources is a clear theme in the source material.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is correct, as wood price relates directly to the production and supply of timber resources, and Smith analyzes it within the context of productive land use and resource allocation. This fits naturally within production economics rather than exchange or distribution.

vsm_relevance — 3.0 / 5.0

Wood price has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it represents market signals about resource scarcity that guide economic decision-making. However, it's more of a market outcome than a systemic function, making the VSM mapping somewhat indirect.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating the mechanism of resource substitution (wood vs. coal) and how land use changes affect commodity prices. It reveals structural relationships between agricultural development, resource scarcity, and market pricing rather than merely naming a surface phenomenon.

3.7 KiB Raw Blame History