Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

public_law_on_coinage

null

2026-02-23T06:13:20.206577

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies public law on coinage as official regulations governing money production, valuation, and use, with specific focus on monetary stability and preventing debasement. This captures a distinct regulatory concept without circularity, though it could be slightly more precise about the scope of "official regulations."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Book I, Chapter 5 where Smith extensively discusses how government regulations on coinage affect monetary systems and the problems of debasement. Smith explicitly examines the role of public authority in maintaining coin standards and preventing fraud.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate for this entity, as it deals with government rules and oversight of monetary systems. This is fundamentally about regulatory mechanisms rather than market operations or other economic categories.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation/audit) as it represents the regulatory oversight function that maintains system standards and prevents degradation. It also has some S2 coordination aspects in preventing monetary oscillations and instability.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural mechanism in Smith's monetary theory—how regulatory frameworks maintain monetary integrity and prevent system breakdown through debasement. It explains a key institutional foundation for stable money rather than just naming a surface phenomenon.

Evaluation: Public Law On Coinage

definition_precision — 4.0 / 5.0

The definition clearly identifies public law on coinage as official regulations governing money production, valuation, and use, with specific focus on monetary stability and preventing debasement. This captures a distinct regulatory concept without circularity, though it could be slightly more precise about the scope of "official regulations."

source_grounding — 5.0 / 5.0

This entity is well-grounded in Book I, Chapter 5 where Smith extensively discusses how government regulations on coinage affect monetary systems and the problems of debasement. Smith explicitly examines the role of public authority in maintaining coin standards and preventing fraud.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate for this entity, as it deals with government rules and oversight of monetary systems. This is fundamentally about regulatory mechanisms rather than market operations or other economic categories.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation/audit) as it represents the regulatory oversight function that maintains system standards and prevents degradation. It also has some S2 coordination aspects in preventing monetary oscillations and instability.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural mechanism in Smith's monetary theory—how regulatory frameworks maintain monetary integrity and prevent system breakdown through debasement. It explains a key institutional foundation for stable money rather than just naming a surface phenomenon.

3.5 KiB Raw Blame History