feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: agricultural_price_discrimination
evaluator: null
evaluated_at: '2026-02-23T00:29:34.716116'
overall_score: 3.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly describes a specific economic practice with distinct
characteristics (different prices for same product based on willingness/ability
to pay). It avoids circularity and captures a well-defined concept, though it
could be slightly more precise about the mechanisms involved.
- name: source_grounding
value: 3.0
max_value: 5.0
rationale: While Smith does discuss agricultural markets, pricing variations, and
transportation costs in Book I Chapter 11, the specific framing as "price discrimination"
uses modern economic terminology that may not directly reflect Smith's conceptual
framework. The underlying phenomena are present but the analytical lens is somewhat
anachronistic.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate for this concept, as price
discrimination is fundamentally about market transactions and pricing mechanisms.
This clearly belongs in the exchange/market category rather than production or
distribution domains.
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This entity describes a market behavior/strategy rather than a systemic
function, making it difficult to map naturally to any specific VSM system. It's
more of a market phenomenon than an organizational or systemic mechanism that
would fit the VSM framework.
- name: explanatory_value
value: 3.0
max_value: 5.0
rationale: The concept provides moderate explanatory value by identifying how agricultural
sellers can extract different prices in different markets, but it primarily names
a pricing strategy rather than illuminating deeper structural mechanisms about
how agricultural markets function or self-organize.
---
# Evaluation: Agricultural Price Discrimination
## definition_precision — 4.0 / 5.0
The definition clearly describes a specific economic practice with distinct characteristics (different prices for same product based on willingness/ability to pay). It avoids circularity and captures a well-defined concept, though it could be slightly more precise about the mechanisms involved.
## source_grounding — 3.0 / 5.0
While Smith does discuss agricultural markets, pricing variations, and transportation costs in Book I Chapter 11, the specific framing as "price discrimination" uses modern economic terminology that may not directly reflect Smith's conceptual framework. The underlying phenomena are present but the analytical lens is somewhat anachronistic.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate for this concept, as price discrimination is fundamentally about market transactions and pricing mechanisms. This clearly belongs in the exchange/market category rather than production or distribution domains.
## vsm_relevance — 2.0 / 5.0
This entity describes a market behavior/strategy rather than a systemic function, making it difficult to map naturally to any specific VSM system. It's more of a market phenomenon than an organizational or systemic mechanism that would fit the VSM framework.
## explanatory_value — 3.0 / 5.0
The concept provides moderate explanatory value by identifying how agricultural sellers can extract different prices in different markets, but it primarily names a pricing strategy rather than illuminating deeper structural mechanisms about how agricultural markets function or self-organize.