Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

computed_exchange_rate

null

2026-02-23T05:02:01.037160

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes computed exchange rate from real exchange rate, specifying it's based on official mint standards assuming full legal weight of precious metal. The concept is precise and non-circular, though it could benefit from a more explicit mathematical formulation.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book IV, Chapter 3, where he explicitly discusses the distinction between computed and real exchange rates in the context of currency debasement and trade balance calculations. The entity accurately reflects Smith's theoretical framework.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate, as this concept deals specifically with currency exchange mechanisms and the theoretical foundations of exchange rate calculation. It fits naturally within monetary and international trade theory.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S4 (intelligence) as it represents a theoretical model for understanding environmental conditions affecting trade. However, it's primarily a measurement concept rather than a systemic function, making VSM placement somewhat forced.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides significant explanatory value by illuminating the structural mechanism behind exchange rate discrepancies and why market rates diverge from theoretical calculations. It helps explain a key source of confusion in 18th-century trade balance analysis.

Evaluation: Computed Exchange Rate

definition_precision — 4.0 / 5.0

The definition clearly distinguishes computed exchange rate from real exchange rate, specifying it's based on official mint standards assuming full legal weight of precious metal. The concept is precise and non-circular, though it could benefit from a more explicit mathematical formulation.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book IV, Chapter 3, where he explicitly discusses the distinction between computed and real exchange rates in the context of currency debasement and trade balance calculations. The entity accurately reflects Smith's theoretical framework.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate, as this concept deals specifically with currency exchange mechanisms and the theoretical foundations of exchange rate calculation. It fits naturally within monetary and international trade theory.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S4 (intelligence) as it represents a theoretical model for understanding environmental conditions affecting trade. However, it's primarily a measurement concept rather than a systemic function, making VSM placement somewhat forced.

explanatory_value — 4.0 / 5.0

The entity provides significant explanatory value by illuminating the structural mechanism behind exchange rate discrepancies and why market rates diverge from theoretical calculations. It helps explain a key source of confusion in 18th-century trade balance analysis.

3.5 KiB Raw Blame History