feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: agricultural_price_mechanism
evaluator: null
evaluated_at: '2026-02-23T00:30:08.335246'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly describes a specific market mechanism involving
supply-demand interaction for agricultural goods, with distinct functions of signaling
scarcity/abundance and guiding resource allocation. It avoids circularity and
captures a well-defined economic process rather than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's extensive discussion of agricultural
markets in Book I, Chapter 11, where he analyzes how prices coordinate agricultural
production and the effects of government interventions like bounties. The context
accurately reflects Smith's actual arguments about price mechanisms and market
distortions.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since this entity describes
the market process of price formation through trading interactions between buyers
and sellers. Agricultural price mechanisms are fundamentally about exchange relationships
and market coordination.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S2 (coordination/anti-oscillation) as price
mechanisms coordinate economic activity and dampen market oscillations through
information signaling. It also has relevance to S4 (intelligence) as prices convey
environmental information about resource scarcity to market participants.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides substantial explanatory power by illuminating the
fundamental mechanism through which decentralized agricultural markets coordinate
resource allocation without central planning. It explains both the information
transmission function of prices and their role in guiding production decisions.
---
# Evaluation: Agricultural Price Mechanism
## definition_precision — 4.0 / 5.0
The definition clearly describes a specific market mechanism involving supply-demand interaction for agricultural goods, with distinct functions of signaling scarcity/abundance and guiding resource allocation. It avoids circularity and captures a well-defined economic process rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's extensive discussion of agricultural markets in Book I, Chapter 11, where he analyzes how prices coordinate agricultural production and the effects of government interventions like bounties. The context accurately reflects Smith's actual arguments about price mechanisms and market distortions.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since this entity describes the market process of price formation through trading interactions between buyers and sellers. Agricultural price mechanisms are fundamentally about exchange relationships and market coordination.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S2 (coordination/anti-oscillation) as price mechanisms coordinate economic activity and dampen market oscillations through information signaling. It also has relevance to S4 (intelligence) as prices convey environmental information about resource scarcity to market participants.
## explanatory_value — 5.0 / 5.0
This entity provides substantial explanatory power by illuminating the fundamental mechanism through which decentralized agricultural markets coordinate resource allocation without central planning. It explains both the information transmission function of prices and their role in guiding production decisions.