Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

copper_money

null

2026-02-23T05:02:51.161144

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies copper money as the lowest denomination metallic currency used for small transactions, which is precise and non-circular. It could be slightly more specific about its role relative to other metals in the monetary hierarchy.

name	value	max_value	rationale
source_grounding	5.0	5.0	Smith explicitly discusses copper money in Book I, Chapter 5 as part of his analysis of different metals serving monetary functions, making this entity well-grounded in the source text. The context accurately reflects Smith's examination of copper's role alongside silver and gold.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Exchange" domain is entirely appropriate since copper money is fundamentally about the medium of exchange function within Smith's monetary theory. This aligns perfectly with Smith's discussion of how different metals facilitate different types of transactions.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Copper money maps most naturally to S1 (primary operations) as it represents the basic operational currency for small-scale transactions within the economic system. However, the mapping is not particularly strong since it's more of a tool than a systemic function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important structural mechanism in Smith's monetary theory—how different metals serve different transactional needs based on value and convenience. It helps explain the hierarchical organization of metallic currency systems rather than merely naming a surface phenomenon.

Evaluation: Copper Money

definition_precision — 4.0 / 5.0

The definition clearly identifies copper money as the lowest denomination metallic currency used for small transactions, which is precise and non-circular. It could be slightly more specific about its role relative to other metals in the monetary hierarchy.

source_grounding — 5.0 / 5.0

Smith explicitly discusses copper money in Book I, Chapter 5 as part of his analysis of different metals serving monetary functions, making this entity well-grounded in the source text. The context accurately reflects Smith's examination of copper's role alongside silver and gold.

domain_placement — 5.0 / 5.0

Placement in the "Exchange" domain is entirely appropriate since copper money is fundamentally about the medium of exchange function within Smith's monetary theory. This aligns perfectly with Smith's discussion of how different metals facilitate different types of transactions.

vsm_relevance — 3.0 / 5.0

Copper money maps most naturally to S1 (primary operations) as it represents the basic operational currency for small-scale transactions within the economic system. However, the mapping is not particularly strong since it's more of a tool than a systemic function.

explanatory_value — 4.0 / 5.0

This entity illuminates an important structural mechanism in Smith's monetary theory—how different metals serve different transactional needs based on value and convenience. It helps explain the hierarchical organization of metallic currency systems rather than merely naming a surface phenomenon.

3.4 KiB Raw Blame History