Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

real_exchange_rate

null

2026-02-23T06:15:34.599192

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes real exchange rate from nominal/official rates by focusing on actual market conditions and coin degradation. It precisely identifies the mechanism (wear, clipping, debasement) that creates the divergence from mint standards.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book IV, Chapter 3, where he extensively discusses how actual exchange rates differ from computed rates due to the physical condition of circulating coins. Smith uses this distinction to critique superficial interpretations of trade balances.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate, as this concept deals specifically with currency exchange mechanisms and international monetary transactions. It sits naturally within Smith's broader discussion of international trade and monetary systems.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents crucial market intelligence about true currency values that differs from official data. It also has S3 relevance as it reveals the actual operational reality versus formal accounting measures.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This concept provides significant explanatory power by revealing why apparent trade imbalances may be misleading and how market mechanisms adjust for currency degradation. It illuminates a key structural relationship between monetary conditions and international trade flows.

Evaluation: Real Exchange Rate

definition_precision — 4.0 / 5.0

The definition clearly distinguishes real exchange rate from nominal/official rates by focusing on actual market conditions and coin degradation. It precisely identifies the mechanism (wear, clipping, debasement) that creates the divergence from mint standards.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book IV, Chapter 3, where he extensively discusses how actual exchange rates differ from computed rates due to the physical condition of circulating coins. Smith uses this distinction to critique superficial interpretations of trade balances.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate, as this concept deals specifically with currency exchange mechanisms and international monetary transactions. It sits naturally within Smith's broader discussion of international trade and monetary systems.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents crucial market intelligence about true currency values that differs from official data. It also has S3 relevance as it reveals the actual operational reality versus formal accounting measures.

explanatory_value — 5.0 / 5.0

This concept provides significant explanatory power by revealing why apparent trade imbalances may be misleading and how market mechanisms adjust for currency degradation. It illuminates a key structural relationship between monetary conditions and international trade flows.

3.4 KiB Raw Blame History