Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

value_of_gold

null

2026-02-23T06:36:44.854455

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes the value of gold as its purchasing power in terms of labor or commodities, avoiding circularity by grounding it in what gold can command rather than defining it in terms of itself. It appropriately contextualizes this within Smith's comparative analysis with silver and market dynamics.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual analysis in Book I, Chapter 5, where he extensively discusses the relative values of gold and silver, their historical fluctuations, and how changes in mine productivity affect their purchasing power. The definition accurately reflects Smith's treatment of precious metals as commodities whose values fluctuate based on supply and demand conditions.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since Smith's discussion of gold's value is fundamentally about its role as a medium of exchange and store of value in monetary systems. This placement correctly captures the entity's function within the broader framework of market exchange mechanisms.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it represents information about relative values that economic actors use to make decisions. However, it's somewhat abstract as a pure value concept rather than an operational mechanism.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides substantial explanatory value by illuminating how monetary systems adapt to changes in the relative scarcity of precious metals, demonstrating Smith's insight that even money itself is subject to market forces. It reveals the structural relationship between commodity production and monetary stability.

Evaluation: Value Of Gold

definition_precision — 4.0 / 5.0

The definition clearly distinguishes the value of gold as its purchasing power in terms of labor or commodities, avoiding circularity by grounding it in what gold can command rather than defining it in terms of itself. It appropriately contextualizes this within Smith's comparative analysis with silver and market dynamics.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual analysis in Book I, Chapter 5, where he extensively discusses the relative values of gold and silver, their historical fluctuations, and how changes in mine productivity affect their purchasing power. The definition accurately reflects Smith's treatment of precious metals as commodities whose values fluctuate based on supply and demand conditions.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since Smith's discussion of gold's value is fundamentally about its role as a medium of exchange and store of value in monetary systems. This placement correctly captures the entity's function within the broader framework of market exchange mechanisms.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it represents information about relative values that economic actors use to make decisions. However, it's somewhat abstract as a pure value concept rather than an operational mechanism.

explanatory_value — 4.0 / 5.0

The entity provides substantial explanatory value by illuminating how monetary systems adapt to changes in the relative scarcity of precious metals, demonstrating Smith's insight that even money itself is subject to market forces. It reveals the structural relationship between commodity production and monetary stability.

3.9 KiB Raw Blame History