Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

trade_balance_mechanism

null

2026-02-23T06:32:59.111794

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly describes a specific automatic adjustment mechanism involving exchange rates, prices, and precious metal flows to balance trade. It avoids circularity and captures a distinct economic process rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis in Book IV, Chapter 1, where he explicitly discusses how trade imbalances self-correct through natural market mechanisms without government intervention. The description accurately reflects Smith's argument about automatic adjustment processes.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for this entity, as it deals with international trade flows, currency adjustments, and the mechanisms that govern trade relationships between nations. This is fundamentally about exchange processes.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as it describes a natural regulatory mechanism that prevents trade imbalances from becoming extreme, and also connects to S3 (internal regulation) through its automatic adjustment function. It represents a clear cybernetic control mechanism.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides substantial explanatory power by illuminating the specific mechanism through which Smith argues markets self-regulate international trade without government intervention. It reveals the structural logic underlying Smith's critique of mercantilist trade policies.

Evaluation: Trade Balance Mechanism

definition_precision — 4.0 / 5.0

The definition clearly describes a specific automatic adjustment mechanism involving exchange rates, prices, and precious metal flows to balance trade. It avoids circularity and captures a distinct economic process rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis in Book IV, Chapter 1, where he explicitly discusses how trade imbalances self-correct through natural market mechanisms without government intervention. The description accurately reflects Smith's argument about automatic adjustment processes.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for this entity, as it deals with international trade flows, currency adjustments, and the mechanisms that govern trade relationships between nations. This is fundamentally about exchange processes.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as it describes a natural regulatory mechanism that prevents trade imbalances from becoming extreme, and also connects to S3 (internal regulation) through its automatic adjustment function. It represents a clear cybernetic control mechanism.

explanatory_value — 5.0 / 5.0

This entity provides substantial explanatory power by illuminating the specific mechanism through which Smith argues markets self-regulate international trade without government intervention. It reveals the structural logic underlying Smith's critique of mercantilist trade policies.

3.4 KiB Raw Blame History