Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

public_generosity_in_coinage

null

2026-02-23T06:13:01.473573

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a specific government policy regarding coinage costs. It clearly distinguishes this practice from charging seignorage and identifies the economic consequence as an unnecessary subsidy.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit criticism of government coinage practices in Book IV, Chapter 6. Smith specifically discusses the government bearing coinage expenses as misguided generosity that provides no public benefit.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is correct, as this concerns government policy decisions about how to structure and fund mint operations. This is clearly a regulatory choice about public finance and monetary administration.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This maps reasonably to S3 (internal regulation) as it concerns government resource allocation and operational policies. However, it's somewhat VSM-neutral as it primarily describes a policy choice rather than a systemic function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism of how government policies can create unintended subsidies and misallocate public resources. It demonstrates Smith's broader principle about the need for cost-conscious government operations and proper pricing of public services.

Evaluation: Public Generosity In Coinage

definition_precision — 4.0 / 5.0

The definition is precise and captures a specific government policy regarding coinage costs. It clearly distinguishes this practice from charging seignorage and identifies the economic consequence as an unnecessary subsidy.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit criticism of government coinage practices in Book IV, Chapter 6. Smith specifically discusses the government bearing coinage expenses as misguided generosity that provides no public benefit.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is correct, as this concerns government policy decisions about how to structure and fund mint operations. This is clearly a regulatory choice about public finance and monetary administration.

vsm_relevance — 3.0 / 5.0

This maps reasonably to S3 (internal regulation) as it concerns government resource allocation and operational policies. However, it's somewhat VSM-neutral as it primarily describes a policy choice rather than a systemic function.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism of how government policies can create unintended subsidies and misallocate public resources. It demonstrates Smith's broader principle about the need for cost-conscious government operations and proper pricing of public services.

3.1 KiB Raw Blame History