feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: agricultural_price_stability
evaluator: null
evaluated_at: '2026-02-23T00:30:28.332077'
overall_score: 3.8
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes agricultural price stability as
a specific economic phenomenon with measurable characteristics (constant prices
over time, resistance to supply/demand fluctuations). While it could be slightly
more precise about the timeframe and degree of stability, it avoids circularity
and captures a distinct concept.
- name: source_grounding
value: 3.0
max_value: 5.0
rationale: Smith does discuss agricultural prices and market interventions in Book
I, Chapter 11, but the specific framing of "agricultural price stability" as a
policy goal or economic concept may be more of a modern interpretation than something
Smith explicitly theorized. The context description suggests Smith was skeptical
of price stabilization attempts, which is accurate to his general philosophy.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain placement since this concept fundamentally
concerns government intervention in markets and policy mechanisms to control price
fluctuations. This fits perfectly within regulatory economics rather than production,
trade, or other domains.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S2 (coordination/anti-oscillation) as it directly
concerns dampening market oscillations and maintaining system stability. It also
has relevance to S3 (internal regulation) regarding monitoring and controlling
economic variables within the system.
- name: explanatory_value
value: 3.0
max_value: 5.0
rationale: While the entity identifies an important economic phenomenon, it primarily
describes a desired outcome rather than explaining the underlying mechanisms that
create or prevent price stability. It has moderate explanatory value but could
better illuminate the structural relationships Smith discusses regarding market
forces versus intervention.
---
# Evaluation: Agricultural Price Stability
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes agricultural price stability as a specific economic phenomenon with measurable characteristics (constant prices over time, resistance to supply/demand fluctuations). While it could be slightly more precise about the timeframe and degree of stability, it avoids circularity and captures a distinct concept.
## source_grounding — 3.0 / 5.0
Smith does discuss agricultural prices and market interventions in Book I, Chapter 11, but the specific framing of "agricultural price stability" as a policy goal or economic concept may be more of a modern interpretation than something Smith explicitly theorized. The context description suggests Smith was skeptical of price stabilization attempts, which is accurate to his general philosophy.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain placement since this concept fundamentally concerns government intervention in markets and policy mechanisms to control price fluctuations. This fits perfectly within regulatory economics rather than production, trade, or other domains.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S2 (coordination/anti-oscillation) as it directly concerns dampening market oscillations and maintaining system stability. It also has relevance to S3 (internal regulation) regarding monitoring and controlling economic variables within the system.
## explanatory_value — 3.0 / 5.0
While the entity identifies an important economic phenomenon, it primarily describes a desired outcome rather than explaining the underlying mechanisms that create or prevent price stability. It has moderate explanatory value but could better illuminate the structural relationships Smith discusses regarding market forces versus intervention.