Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

gold_money

null

2026-02-23T05:33:18.037163

3.4

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition identifies gold money as the highest denomination metallic currency for large transactions and value storage, which is reasonably specific. However, it lacks precision about what constitutes "highest denomination" and could be more explicit about gold's unique monetary properties versus other metals.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does extensively discuss gold's role in monetary systems throughout Book I, particularly in chapters on money and exchange. The entity accurately reflects Smith's analysis of gold as both a medium of exchange and store of value, though the specific framing as "highest denomination" may be somewhat interpretive.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for gold money, as Smith's discussion centers on gold's function as a medium of exchange and unit of account. This placement aligns well with the monetary theory context of Book I, Chapter 5.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Gold money as a currency denomination is primarily an operational tool rather than a systemic function, making it largely VSM-neutral. While it might tangentially relate to S1 (operational transactions), it doesn't naturally map to any specific VSM system's regulatory or intelligence functions.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The entity provides moderate explanatory value by highlighting gold's specific role in large transactions and value storage within Smith's monetary framework. However, it primarily describes a monetary instrument rather than illuminating deeper mechanisms of how monetary systems function or evolve.

Evaluation: Gold Money

definition_precision — 3.0 / 5.0

The definition identifies gold money as the highest denomination metallic currency for large transactions and value storage, which is reasonably specific. However, it lacks precision about what constitutes "highest denomination" and could be more explicit about gold's unique monetary properties versus other metals.

source_grounding — 4.0 / 5.0

Smith does extensively discuss gold's role in monetary systems throughout Book I, particularly in chapters on money and exchange. The entity accurately reflects Smith's analysis of gold as both a medium of exchange and store of value, though the specific framing as "highest denomination" may be somewhat interpretive.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for gold money, as Smith's discussion centers on gold's function as a medium of exchange and unit of account. This placement aligns well with the monetary theory context of Book I, Chapter 5.

vsm_relevance — 2.0 / 5.0

Gold money as a currency denomination is primarily an operational tool rather than a systemic function, making it largely VSM-neutral. While it might tangentially relate to S1 (operational transactions), it doesn't naturally map to any specific VSM system's regulatory or intelligence functions.

explanatory_value — 3.0 / 5.0

The entity provides moderate explanatory value by highlighting gold's specific role in large transactions and value storage within Smith's monetary framework. However, it primarily describes a monetary instrument rather than illuminating deeper mechanisms of how monetary systems function or evolve.

3.6 KiB Raw Blame History