Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_price_equalization

null

2026-02-23T00:29:52.045463

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly describes a specific market mechanism where agricultural prices equalize across distances with transportation costs factored in. It avoids circularity and captures a distinct economic phenomenon, though it could be slightly more precise about the equilibrium conditions.

name	value	max_value	rationale
source_grounding	4.0	5.0	This concept aligns well with Smith's discussion of how market forces operate in agricultural contexts and his analysis of price formation mechanisms. While Smith may not use this exact terminology, the underlying principle of price equalization through market forces is consistent with his theoretical framework.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate as this entity describes a price formation mechanism that emerges from market transactions and trade relationships. It fundamentally concerns how goods are exchanged and priced across different locations.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S2 (coordination) as it describes how market mechanisms coordinate pricing across different locations. It also touches on S1 (operations) regarding actual agricultural production and distribution activities.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine insight into how market mechanisms automatically adjust for spatial differences and transportation costs, illustrating Smith's broader point about market efficiency. It explains a structural relationship between location, costs, and pricing rather than merely naming a surface phenomenon.

Evaluation: Agricultural Price Equalization

definition_precision — 4.0 / 5.0

The definition clearly describes a specific market mechanism where agricultural prices equalize across distances with transportation costs factored in. It avoids circularity and captures a distinct economic phenomenon, though it could be slightly more precise about the equilibrium conditions.

source_grounding — 4.0 / 5.0

This concept aligns well with Smith's discussion of how market forces operate in agricultural contexts and his analysis of price formation mechanisms. While Smith may not use this exact terminology, the underlying principle of price equalization through market forces is consistent with his theoretical framework.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate as this entity describes a price formation mechanism that emerges from market transactions and trade relationships. It fundamentally concerns how goods are exchanged and priced across different locations.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S2 (coordination) as it describes how market mechanisms coordinate pricing across different locations. It also touches on S1 (operations) regarding actual agricultural production and distribution activities.

explanatory_value — 4.0 / 5.0

The entity provides genuine insight into how market mechanisms automatically adjust for spatial differences and transportation costs, illustrating Smith's broader point about market efficiency. It explains a structural relationship between location, costs, and pricing rather than merely naming a surface phenomenon.

3.6 KiB Raw Blame History