Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

degradation_of_silver

null

2026-02-23T05:05:27.944185

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes degradation of silver as a specific reduction in purchasing power caused by artificial policies like bounties, rather than general inflation. It precisely identifies the mechanism: nominal price increases without real value increases.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book IV, Chapter 5, where he explicitly discusses how bounties on corn exports force up nominal prices and thereby reduce silver's purchasing power relative to home-made goods. The entity accurately reflects Smith's actual argument about the relationship between bounties, corn prices, and silver's value.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this concept deals fundamentally with the relative values of silver versus other commodities and how policy interventions distort these exchange relationships. This is a core exchange mechanism rather than production, distribution, or consumption.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance as it represents a systemic dysfunction where S4 intelligence (policy decisions about bounties) creates unintended consequences that distort the economic system's internal operations. However, it's more of a pathological outcome than a structural component of viable system operation.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides strong explanatory value by illuminating a specific causal mechanism linking trade policy interventions to monetary effects. It reveals how artificial price supports create systemic distortions that propagate through the economy via the price system, going beyond merely naming a phenomenon to explain its structural causes.

Evaluation: Degradation Of Silver

definition_precision — 4.0 / 5.0

The definition clearly distinguishes degradation of silver as a specific reduction in purchasing power caused by artificial policies like bounties, rather than general inflation. It precisely identifies the mechanism: nominal price increases without real value increases.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book IV, Chapter 5, where he explicitly discusses how bounties on corn exports force up nominal prices and thereby reduce silver's purchasing power relative to home-made goods. The entity accurately reflects Smith's actual argument about the relationship between bounties, corn prices, and silver's value.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this concept deals fundamentally with the relative values of silver versus other commodities and how policy interventions distort these exchange relationships. This is a core exchange mechanism rather than production, distribution, or consumption.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance as it represents a systemic dysfunction where S4 intelligence (policy decisions about bounties) creates unintended consequences that distort the economic system's internal operations. However, it's more of a pathological outcome than a structural component of viable system operation.

explanatory_value — 4.0 / 5.0

This entity provides strong explanatory value by illuminating a specific causal mechanism linking trade policy interventions to monetary effects. It reveals how artificial price supports create systemic distortions that propagate through the economy via the price system, going beyond merely naming a phenomenon to explain its structural causes.

3.9 KiB Raw Blame History