Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

silver_price_variation

null

2026-02-23T06:21:30.147355

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly specifies what is being measured (silver value relative to other commodities, particularly corn) and identifies the key causal factors (supply from mines, demand from commerce). It avoids circularity and captures a distinct economic phenomenon rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed empirical analysis in Book I, Chapter 11, where he extensively examines historical silver price data relative to corn over four centuries. The entity accurately reflects Smith's actual investigation rather than imposing external concepts.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this entity concerns the relative exchange values between silver and other commodities over time. This is fundamentally about exchange relationships and price mechanisms in markets.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents the economic system's response to environmental changes in silver supply and commercial demand. It also connects to S1 as it affects primary market operations through changing relative values.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides substantial explanatory power by illuminating the mechanism through which precious metal values adjust to supply and demand changes, serving as evidence for Smith's broader theories about wealth, commerce, and monetary systems. It reveals structural relationships between mining output, commercial development, and price formation.

Evaluation: Silver Price Variation

definition_precision — 4.0 / 5.0

The definition clearly specifies what is being measured (silver value relative to other commodities, particularly corn) and identifies the key causal factors (supply from mines, demand from commerce). It avoids circularity and captures a distinct economic phenomenon rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed empirical analysis in Book I, Chapter 11, where he extensively examines historical silver price data relative to corn over four centuries. The entity accurately reflects Smith's actual investigation rather than imposing external concepts.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this entity concerns the relative exchange values between silver and other commodities over time. This is fundamentally about exchange relationships and price mechanisms in markets.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents the economic system's response to environmental changes in silver supply and commercial demand. It also connects to S1 as it affects primary market operations through changing relative values.

explanatory_value — 5.0 / 5.0

This entity provides substantial explanatory power by illuminating the mechanism through which precious metal values adjust to supply and demand changes, serving as evidence for Smith's broader theories about wealth, commerce, and monetary systems. It reveals structural relationships between mining output, commercial development, and price formation.

3.6 KiB Raw Blame History