Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

metal_currency

null

2026-02-23T05:51:58.677413

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a distinct concept - metals as exchange medium with specific properties (durability, divisibility, proportionality). It avoids circularity and clearly distinguishes metal currency from other forms of exchange media.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses why metals became preferred exchange media. The specific properties mentioned (durability, divisibility, precise proportioning) align closely with Smith's actual arguments.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain placement is correct, as metal currency is fundamentally about facilitating exchange transactions. This fits perfectly within the conceptual category of exchange mechanisms and media.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Metal currency maps most naturally to S1 (primary operations) as it's a fundamental operational tool for exchange, but it also has S2 coordination aspects by standardizing exchange processes. However, it's somewhat abstract as an exchange medium rather than a clear systemic function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating the mechanism behind why certain materials become dominant exchange media. It explains the structural relationship between material properties and exchange functionality, going beyond merely naming a phenomenon.

Evaluation: Metal Currency

definition_precision — 4.0 / 5.0

The definition is precise and captures a distinct concept - metals as exchange medium with specific properties (durability, divisibility, proportionality). It avoids circularity and clearly distinguishes metal currency from other forms of exchange media.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses why metals became preferred exchange media. The specific properties mentioned (durability, divisibility, precise proportioning) align closely with Smith's actual arguments.

domain_placement — 5.0 / 5.0

The "Exchange" domain placement is correct, as metal currency is fundamentally about facilitating exchange transactions. This fits perfectly within the conceptual category of exchange mechanisms and media.

vsm_relevance — 3.0 / 5.0

Metal currency maps most naturally to S1 (primary operations) as it's a fundamental operational tool for exchange, but it also has S2 coordination aspects by standardizing exchange processes. However, it's somewhat abstract as an exchange medium rather than a clear systemic function.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating the mechanism behind why certain materials become dominant exchange media. It explains the structural relationship between material properties and exchange functionality, going beyond merely naming a phenomenon.

3.2 KiB Raw Blame History