Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agio_of_bank_money

null

2026-02-23T00:25:16.998391

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly distinguishing the agio as the specific premium/discount differential between bank money and circulating currency. It captures a distinct financial mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed discussion of the Amsterdam bank in Book IV, Chapter 3, where he explicitly analyzes how the agio functions and varies based on currency quality differences. The concept emerges clearly from the source text without interpretation.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain assignment is perfectly appropriate, as the agio represents a core exchange rate mechanism between different forms of money. This is fundamentally about currency exchange relationships rather than production, trade, or other economic domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as Smith describes how banks manipulate the agio to prevent stock-jobbing and maintain currency stability. It represents a regulatory mechanism that coordinates between different monetary systems.

name	value	max_value	rationale
explanatory_value	5.0	5.0	The agio provides significant explanatory power by illuminating the structural mechanism through which different qualities of money relate to each other in exchange systems. It reveals how monetary institutions manage currency stability through price differentials rather than merely naming a surface phenomenon.

Evaluation: Agio Of Bank Money

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly distinguishing the agio as the specific premium/discount differential between bank money and circulating currency. It captures a distinct financial mechanism rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed discussion of the Amsterdam bank in Book IV, Chapter 3, where he explicitly analyzes how the agio functions and varies based on currency quality differences. The concept emerges clearly from the source text without interpretation.

domain_placement — 5.0 / 5.0

The "Exchange" domain assignment is perfectly appropriate, as the agio represents a core exchange rate mechanism between different forms of money. This is fundamentally about currency exchange relationships rather than production, trade, or other economic domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as Smith describes how banks manipulate the agio to prevent stock-jobbing and maintain currency stability. It represents a regulatory mechanism that coordinates between different monetary systems.

explanatory_value — 5.0 / 5.0

The agio provides significant explanatory power by illuminating the structural mechanism through which different qualities of money relate to each other in exchange systems. It reveals how monetary institutions manage currency stability through price differentials rather than merely naming a surface phenomenon.

3.4 KiB Raw Blame History