Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

mint_price

null

2026-02-23T05:53:27.035457

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies mint price as the official rate for coining bullion into currency and establishes its role as a reference point for market price analysis. It's precise and non-circular, though it could be slightly more specific about the institutional authority setting this price.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is well-grounded in Smith's actual text, particularly in Book I, Chapter 5 where he extensively discusses the mint price of gold and silver as benchmarks for understanding market fluctuations. Smith explicitly uses mint price as a analytical tool throughout his monetary discussions.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Regulation" is an appropriate domain since mint price represents government-set official valuations that influence market behavior. However, it could arguably also fit in a "Monetary Theory" or "Price Mechanisms" domain given its central role in Smith's analysis of precious metal markets.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Mint price maps reasonably well to S3 (internal regulation) as it represents an official standard that regulates the monetary system's internal operations. It also has some S2 characteristics as a coordination mechanism that helps stabilize currency valuation, though the mapping isn't as natural as for operational concepts.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating the mechanism through which official valuations interact with market forces in Smith's monetary theory. It's not merely descriptive but reveals an important structural relationship between government policy and market dynamics.

Evaluation: Mint Price

definition_precision — 4.0 / 5.0

The definition clearly identifies mint price as the official rate for coining bullion into currency and establishes its role as a reference point for market price analysis. It's precise and non-circular, though it could be slightly more specific about the institutional authority setting this price.

source_grounding — 5.0 / 5.0

This concept is well-grounded in Smith's actual text, particularly in Book I, Chapter 5 where he extensively discusses the mint price of gold and silver as benchmarks for understanding market fluctuations. Smith explicitly uses mint price as a analytical tool throughout his monetary discussions.

domain_placement — 4.0 / 5.0

"Regulation" is an appropriate domain since mint price represents government-set official valuations that influence market behavior. However, it could arguably also fit in a "Monetary Theory" or "Price Mechanisms" domain given its central role in Smith's analysis of precious metal markets.

vsm_relevance — 3.0 / 5.0

Mint price maps reasonably well to S3 (internal regulation) as it represents an official standard that regulates the monetary system's internal operations. It also has some S2 characteristics as a coordination mechanism that helps stabilize currency valuation, though the mapping isn't as natural as for operational concepts.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating the mechanism through which official valuations interact with market forces in Smith's monetary theory. It's not merely descriptive but reveals an important structural relationship between government policy and market dynamics.

3.7 KiB Raw Blame History