Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_price_mechanism

null

2026-02-23T00:30:08.335246

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly describes a specific market mechanism involving supply-demand interaction for agricultural goods, with distinct functions of signaling scarcity/abundance and guiding resource allocation. It avoids circularity and captures a well-defined economic process rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's extensive discussion of agricultural markets in Book I, Chapter 11, where he analyzes how prices coordinate agricultural production and the effects of government interventions like bounties. The context accurately reflects Smith's actual arguments about price mechanisms and market distortions.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this entity describes the market process of price formation through trading interactions between buyers and sellers. Agricultural price mechanisms are fundamentally about exchange relationships and market coordination.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as price mechanisms coordinate economic activity and dampen market oscillations through information signaling. It also has relevance to S4 (intelligence) as prices convey environmental information about resource scarcity to market participants.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides substantial explanatory power by illuminating the fundamental mechanism through which decentralized agricultural markets coordinate resource allocation without central planning. It explains both the information transmission function of prices and their role in guiding production decisions.

Evaluation: Agricultural Price Mechanism

definition_precision — 4.0 / 5.0

The definition clearly describes a specific market mechanism involving supply-demand interaction for agricultural goods, with distinct functions of signaling scarcity/abundance and guiding resource allocation. It avoids circularity and captures a well-defined economic process rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's extensive discussion of agricultural markets in Book I, Chapter 11, where he analyzes how prices coordinate agricultural production and the effects of government interventions like bounties. The context accurately reflects Smith's actual arguments about price mechanisms and market distortions.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this entity describes the market process of price formation through trading interactions between buyers and sellers. Agricultural price mechanisms are fundamentally about exchange relationships and market coordination.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as price mechanisms coordinate economic activity and dampen market oscillations through information signaling. It also has relevance to S4 (intelligence) as prices convey environmental information about resource scarcity to market participants.

explanatory_value — 5.0 / 5.0

This entity provides substantial explanatory power by illuminating the fundamental mechanism through which decentralized agricultural markets coordinate resource allocation without central planning. It explains both the information transmission function of prices and their role in guiding production decisions.

3.7 KiB Raw Blame History