Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

melting_pot_effects

null

2026-02-23T05:50:16.387825

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a specific economic mechanism where coins are melted when their metal value exceeds face value. It clearly identifies the conditions (no seignorage, degradation) and consequences (currency removal, government intervention) without circularity.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book IV, Chapter 6, where he explicitly discusses the melting pot problem and uses the Penelope's web metaphor. The concept accurately reflects Smith's analysis of currency degradation and mint operations.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate as this describes a regulatory challenge requiring government intervention to maintain currency stability. The phenomenon directly relates to monetary policy and the need for institutional responses to market failures.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation) as it represents a control problem where the system must monitor and respond to currency degradation, and potentially S2 (coordination) as it involves managing oscillations between minting and melting. It demonstrates clear cybernetic feedback loops.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the structural mechanism behind currency instability and the dynamic relationship between market incentives and monetary policy. It explains why governments need seignorage and active currency management rather than just describing surface phenomena.

Evaluation: Melting Pot Effects

definition_precision — 4.0 / 5.0

The definition is precise and captures a specific economic mechanism where coins are melted when their metal value exceeds face value. It clearly identifies the conditions (no seignorage, degradation) and consequences (currency removal, government intervention) without circularity.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book IV, Chapter 6, where he explicitly discusses the melting pot problem and uses the Penelope's web metaphor. The concept accurately reflects Smith's analysis of currency degradation and mint operations.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate as this describes a regulatory challenge requiring government intervention to maintain currency stability. The phenomenon directly relates to monetary policy and the need for institutional responses to market failures.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation) as it represents a control problem where the system must monitor and respond to currency degradation, and potentially S2 (coordination) as it involves managing oscillations between minting and melting. It demonstrates clear cybernetic feedback loops.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the structural mechanism behind currency instability and the dynamic relationship between market incentives and monetary policy. It explains why governments need seignorage and active currency management rather than just describing surface phenomena.

3.5 KiB Raw Blame History