feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: agricultural_price_equalization
evaluator: null
evaluated_at: '2026-02-23T00:29:52.045463'
overall_score: 4.0
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly describes a specific market mechanism where agricultural
prices equalize across distances with transportation costs factored in. It avoids
circularity and captures a distinct economic phenomenon, though it could be slightly
more precise about the equilibrium conditions.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This concept aligns well with Smith's discussion of how market forces
operate in agricultural contexts and his analysis of price formation mechanisms.
While Smith may not use this exact terminology, the underlying principle of price
equalization through market forces is consistent with his theoretical framework.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate as this entity describes
a price formation mechanism that emerges from market transactions and trade relationships.
It fundamentally concerns how goods are exchanged and priced across different
locations.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S2 (coordination)
as it describes how market mechanisms coordinate pricing across different locations.
It also touches on S1 (operations) regarding actual agricultural production and
distribution activities.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine insight into how market mechanisms automatically
adjust for spatial differences and transportation costs, illustrating Smith's
broader point about market efficiency. It explains a structural relationship between
location, costs, and pricing rather than merely naming a surface phenomenon.
---
# Evaluation: Agricultural Price Equalization
## definition_precision — 4.0 / 5.0
The definition clearly describes a specific market mechanism where agricultural prices equalize across distances with transportation costs factored in. It avoids circularity and captures a distinct economic phenomenon, though it could be slightly more precise about the equilibrium conditions.
## source_grounding — 4.0 / 5.0
This concept aligns well with Smith's discussion of how market forces operate in agricultural contexts and his analysis of price formation mechanisms. While Smith may not use this exact terminology, the underlying principle of price equalization through market forces is consistent with his theoretical framework.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate as this entity describes a price formation mechanism that emerges from market transactions and trade relationships. It fundamentally concerns how goods are exchanged and priced across different locations.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S2 (coordination) as it describes how market mechanisms coordinate pricing across different locations. It also touches on S1 (operations) regarding actual agricultural production and distribution activities.
## explanatory_value — 4.0 / 5.0
The entity provides genuine insight into how market mechanisms automatically adjust for spatial differences and transportation costs, illustrating Smith's broader point about market efficiency. It explains a structural relationship between location, costs, and pricing rather than merely naming a surface phenomenon.