Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

exchange_rate_mechanism

null

2026-02-23T05:24:09.233608

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes exchange rate mechanisms from simple exchange rates by focusing on the systematic process of determination rather than just the rates themselves. It precisely captures the concept as a determinative system rather than a static measure.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion of how exchange rates function as automatic balancing mechanisms in international trade. The context accurately reflects Smith's analysis of exchange rates as self-correcting systems that tax imports and subsidize exports when imbalances occur.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate as this entity deals specifically with the mechanisms governing currency exchange in international trade. This is a core concept within exchange theory and practice.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as it describes an automatic mechanism that prevents extreme trade imbalances through self-correcting adjustments. It also has elements of S4 (intelligence) as it responds to environmental changes in trade flows.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating how exchange rates function as an automatic regulatory mechanism rather than just market prices. It reveals the structural relationship between currency values and trade balance correction that Smith identified as fundamental to international commerce.

Evaluation: Exchange Rate Mechanism

definition_precision — 4.0 / 5.0

The definition clearly distinguishes exchange rate mechanisms from simple exchange rates by focusing on the systematic process of determination rather than just the rates themselves. It precisely captures the concept as a determinative system rather than a static measure.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion of how exchange rates function as automatic balancing mechanisms in international trade. The context accurately reflects Smith's analysis of exchange rates as self-correcting systems that tax imports and subsidize exports when imbalances occur.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate as this entity deals specifically with the mechanisms governing currency exchange in international trade. This is a core concept within exchange theory and practice.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as it describes an automatic mechanism that prevents extreme trade imbalances through self-correcting adjustments. It also has elements of S4 (intelligence) as it responds to environmental changes in trade flows.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating how exchange rates function as an automatic regulatory mechanism rather than just market prices. It reveals the structural relationship between currency values and trade balance correction that Smith identified as fundamental to international commerce.

3.4 KiB Raw Blame History