feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: computed_exchange_rate
evaluator: null
evaluated_at: '2026-02-23T05:02:01.037160'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes computed exchange rate from real
exchange rate, specifying it's based on official mint standards assuming full
legal weight of precious metal. The concept is precise and non-circular, though
it could benefit from a more explicit mathematical formulation.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's analysis in Book IV, Chapter
3, where he explicitly discusses the distinction between computed and real exchange
rates in the context of currency debasement and trade balance calculations. The
entity accurately reflects Smith's theoretical framework.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate, as this concept deals
specifically with currency exchange mechanisms and the theoretical foundations
of exchange rate calculation. It fits naturally within monetary and international
trade theory.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S4 (intelligence)
as it represents a theoretical model for understanding environmental conditions
affecting trade. However, it's primarily a measurement concept rather than a systemic
function, making VSM placement somewhat forced.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides significant explanatory value by illuminating the
structural mechanism behind exchange rate discrepancies and why market rates diverge
from theoretical calculations. It helps explain a key source of confusion in 18th-century
trade balance analysis.
---
# Evaluation: Computed Exchange Rate
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes computed exchange rate from real exchange rate, specifying it's based on official mint standards assuming full legal weight of precious metal. The concept is precise and non-circular, though it could benefit from a more explicit mathematical formulation.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's analysis in Book IV, Chapter 3, where he explicitly discusses the distinction between computed and real exchange rates in the context of currency debasement and trade balance calculations. The entity accurately reflects Smith's theoretical framework.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate, as this concept deals specifically with currency exchange mechanisms and the theoretical foundations of exchange rate calculation. It fits naturally within monetary and international trade theory.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S4 (intelligence) as it represents a theoretical model for understanding environmental conditions affecting trade. However, it's primarily a measurement concept rather than a systemic function, making VSM placement somewhat forced.
## explanatory_value — 4.0 / 5.0
The entity provides significant explanatory value by illuminating the structural mechanism behind exchange rate discrepancies and why market rates diverge from theoretical calculations. It helps explain a key source of confusion in 18th-century trade balance analysis.