Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_price_stability

null

2026-02-23T00:30:28.332077

3.8

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes agricultural price stability as a specific economic phenomenon with measurable characteristics (constant prices over time, resistance to supply/demand fluctuations). While it could be slightly more precise about the timeframe and degree of stability, it avoids circularity and captures a distinct concept.

name	value	max_value	rationale
source_grounding	3.0	5.0	Smith does discuss agricultural prices and market interventions in Book I, Chapter 11, but the specific framing of "agricultural price stability" as a policy goal or economic concept may be more of a modern interpretation than something Smith explicitly theorized. The context description suggests Smith was skeptical of price stabilization attempts, which is accurate to his general philosophy.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain placement since this concept fundamentally concerns government intervention in markets and policy mechanisms to control price fluctuations. This fits perfectly within regulatory economics rather than production, trade, or other domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as it directly concerns dampening market oscillations and maintaining system stability. It also has relevance to S3 (internal regulation) regarding monitoring and controlling economic variables within the system.

name	value	max_value	rationale
explanatory_value	3.0	5.0	While the entity identifies an important economic phenomenon, it primarily describes a desired outcome rather than explaining the underlying mechanisms that create or prevent price stability. It has moderate explanatory value but could better illuminate the structural relationships Smith discusses regarding market forces versus intervention.

Evaluation: Agricultural Price Stability

definition_precision — 4.0 / 5.0

The definition clearly distinguishes agricultural price stability as a specific economic phenomenon with measurable characteristics (constant prices over time, resistance to supply/demand fluctuations). While it could be slightly more precise about the timeframe and degree of stability, it avoids circularity and captures a distinct concept.

source_grounding — 3.0 / 5.0

Smith does discuss agricultural prices and market interventions in Book I, Chapter 11, but the specific framing of "agricultural price stability" as a policy goal or economic concept may be more of a modern interpretation than something Smith explicitly theorized. The context description suggests Smith was skeptical of price stabilization attempts, which is accurate to his general philosophy.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain placement since this concept fundamentally concerns government intervention in markets and policy mechanisms to control price fluctuations. This fits perfectly within regulatory economics rather than production, trade, or other domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as it directly concerns dampening market oscillations and maintaining system stability. It also has relevance to S3 (internal regulation) regarding monitoring and controlling economic variables within the system.

explanatory_value — 3.0 / 5.0

While the entity identifies an important economic phenomenon, it primarily describes a desired outcome rather than explaining the underlying mechanisms that create or prevent price stability. It has moderate explanatory value but could better illuminate the structural relationships Smith discusses regarding market forces versus intervention.

3.9 KiB Raw Blame History