feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: exchange_rate_mechanism
evaluator: null
evaluated_at: '2026-02-23T05:24:09.233608'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes exchange rate mechanisms from simple
exchange rates by focusing on the systematic process of determination rather than
just the rates themselves. It precisely captures the concept as a determinative
system rather than a static measure.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual discussion of how exchange
rates function as automatic balancing mechanisms in international trade. The context
accurately reflects Smith's analysis of exchange rates as self-correcting systems
that tax imports and subsidize exports when imbalances occur.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate as this entity deals specifically
with the mechanisms governing currency exchange in international trade. This is
a core concept within exchange theory and practice.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S2 (coordination/anti-oscillation) as it describes
an automatic mechanism that prevents extreme trade imbalances through self-correcting
adjustments. It also has elements of S4 (intelligence) as it responds to environmental
changes in trade flows.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by illuminating how
exchange rates function as an automatic regulatory mechanism rather than just
market prices. It reveals the structural relationship between currency values
and trade balance correction that Smith identified as fundamental to international
commerce.
---
# Evaluation: Exchange Rate Mechanism
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes exchange rate mechanisms from simple exchange rates by focusing on the systematic process of determination rather than just the rates themselves. It precisely captures the concept as a determinative system rather than a static measure.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual discussion of how exchange rates function as automatic balancing mechanisms in international trade. The context accurately reflects Smith's analysis of exchange rates as self-correcting systems that tax imports and subsidize exports when imbalances occur.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate as this entity deals specifically with the mechanisms governing currency exchange in international trade. This is a core concept within exchange theory and practice.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S2 (coordination/anti-oscillation) as it describes an automatic mechanism that prevents extreme trade imbalances through self-correcting adjustments. It also has elements of S4 (intelligence) as it responds to environmental changes in trade flows.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by illuminating how exchange rates function as an automatic regulatory mechanism rather than just market prices. It reveals the structural relationship between currency values and trade balance correction that Smith identified as fundamental to international commerce.