Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

free_trade

null

2026-02-23T05:31:26.153618

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly specifies "unrestricted exchange of goods and services across borders without government-imposed tariffs, quotas, or other barriers," which is precise and non-circular. It captures a distinct economic concept rather than being vague, though it could be slightly more specific about what constitutes "other barriers."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is strongly grounded in Smith's actual arguments, particularly in Book IV where he extensively critiques mercantile restrictions and advocates for removing artificial barriers to trade. The context accurately reflects Smith's position that free trade represents the natural state that best serves public interest.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the perfect domain placement for free trade, as it fundamentally concerns the mechanisms and conditions under which goods and services are traded between nations. This is clearly an exchange-related concept rather than production, distribution, or consumption.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Free trade maps well to S4 (intelligence/environmental adaptation) as it represents how an economic system adapts to and interacts with its external environment through international commerce. It also has some relevance to S5 (policy/identity) as it reflects fundamental policy choices about economic openness.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanism through which nations can achieve mutual benefit and efficiency gains. It explains how removing artificial barriers allows natural market forces to optimize resource allocation across borders, which is central to Smith's economic theory.

Evaluation: Free Trade

definition_precision — 4.0 / 5.0

The definition clearly specifies "unrestricted exchange of goods and services across borders without government-imposed tariffs, quotas, or other barriers," which is precise and non-circular. It captures a distinct economic concept rather than being vague, though it could be slightly more specific about what constitutes "other barriers."

source_grounding — 5.0 / 5.0

This entity is strongly grounded in Smith's actual arguments, particularly in Book IV where he extensively critiques mercantile restrictions and advocates for removing artificial barriers to trade. The context accurately reflects Smith's position that free trade represents the natural state that best serves public interest.

domain_placement — 5.0 / 5.0

"Exchange" is the perfect domain placement for free trade, as it fundamentally concerns the mechanisms and conditions under which goods and services are traded between nations. This is clearly an exchange-related concept rather than production, distribution, or consumption.

vsm_relevance — 4.0 / 5.0

Free trade maps well to S4 (intelligence/environmental adaptation) as it represents how an economic system adapts to and interacts with its external environment through international commerce. It also has some relevance to S5 (policy/identity) as it reflects fundamental policy choices about economic openness.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanism through which nations can achieve mutual benefit and efficiency gains. It explains how removing artificial barriers allows natural market forces to optimize resource allocation across borders, which is central to Smith's economic theory.

3.8 KiB Raw Blame History