Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_price_discrimination

null

2026-02-23T00:29:34.716116

3.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly describes a specific economic practice with distinct characteristics (different prices for same product based on willingness/ability to pay). It avoids circularity and captures a well-defined concept, though it could be slightly more precise about the mechanisms involved.

name	value	max_value	rationale
source_grounding	3.0	5.0	While Smith does discuss agricultural markets, pricing variations, and transportation costs in Book I Chapter 11, the specific framing as "price discrimination" uses modern economic terminology that may not directly reflect Smith's conceptual framework. The underlying phenomena are present but the analytical lens is somewhat anachronistic.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for this concept, as price discrimination is fundamentally about market transactions and pricing mechanisms. This clearly belongs in the exchange/market category rather than production or distribution domains.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity describes a market behavior/strategy rather than a systemic function, making it difficult to map naturally to any specific VSM system. It's more of a market phenomenon than an organizational or systemic mechanism that would fit the VSM framework.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The concept provides moderate explanatory value by identifying how agricultural sellers can extract different prices in different markets, but it primarily names a pricing strategy rather than illuminating deeper structural mechanisms about how agricultural markets function or self-organize.

Evaluation: Agricultural Price Discrimination

definition_precision — 4.0 / 5.0

The definition clearly describes a specific economic practice with distinct characteristics (different prices for same product based on willingness/ability to pay). It avoids circularity and captures a well-defined concept, though it could be slightly more precise about the mechanisms involved.

source_grounding — 3.0 / 5.0

While Smith does discuss agricultural markets, pricing variations, and transportation costs in Book I Chapter 11, the specific framing as "price discrimination" uses modern economic terminology that may not directly reflect Smith's conceptual framework. The underlying phenomena are present but the analytical lens is somewhat anachronistic.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for this concept, as price discrimination is fundamentally about market transactions and pricing mechanisms. This clearly belongs in the exchange/market category rather than production or distribution domains.

vsm_relevance — 2.0 / 5.0

This entity describes a market behavior/strategy rather than a systemic function, making it difficult to map naturally to any specific VSM system. It's more of a market phenomenon than an organizational or systemic mechanism that would fit the VSM framework.

explanatory_value — 3.0 / 5.0

The concept provides moderate explanatory value by identifying how agricultural sellers can extract different prices in different markets, but it primarily names a pricing strategy rather than illuminating deeper structural mechanisms about how agricultural markets function or self-organize.

3.6 KiB Raw Blame History