Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_price_elasticity

null

2026-02-23T00:29:42.907982

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is mathematically precise, clearly stating the formula for price elasticity and distinguishing between supply and demand elasticity. It avoids circularity and captures a distinct economic concept with measurable parameters.

name	value	max_value	rationale
source_grounding	3.0	5.0	While Smith discusses agricultural supply and demand responses to price changes in Book I Chapter 11, he doesn't explicitly use the formal concept of "price elasticity" or provide the mathematical framework described. The entity extrapolates from Smith's observations using later economic terminology.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since price elasticity fundamentally concerns how markets coordinate supply and demand through price mechanisms. This is a core exchange relationship concept.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as price elasticity describes how markets dampen or amplify price fluctuations through supply/demand responses. It also relates to S4 (intelligence) regarding market adaptation to environmental changes.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The concept provides genuine explanatory power by illuminating the mechanism through which agricultural markets respond to price signals and why some markets are more volatile than others. It explains structural market behavior rather than just naming a phenomenon.

Evaluation: Agricultural Price Elasticity

definition_precision — 4.0 / 5.0

The definition is mathematically precise, clearly stating the formula for price elasticity and distinguishing between supply and demand elasticity. It avoids circularity and captures a distinct economic concept with measurable parameters.

source_grounding — 3.0 / 5.0

While Smith discusses agricultural supply and demand responses to price changes in Book I Chapter 11, he doesn't explicitly use the formal concept of "price elasticity" or provide the mathematical framework described. The entity extrapolates from Smith's observations using later economic terminology.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since price elasticity fundamentally concerns how markets coordinate supply and demand through price mechanisms. This is a core exchange relationship concept.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as price elasticity describes how markets dampen or amplify price fluctuations through supply/demand responses. It also relates to S4 (intelligence) regarding market adaptation to environmental changes.

explanatory_value — 4.0 / 5.0

The concept provides genuine explanatory power by illuminating the mechanism through which agricultural markets respond to price signals and why some markets are more volatile than others. It explains structural market behavior rather than just naming a phenomenon.

3.2 KiB Raw Blame History