Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

restraints_upon_importation

null

2026-02-23T06:17:42.823246

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, distinguishing between complete prohibitions and high tariffs as mechanisms to create domestic monopolies. It avoids circularity and captures a distinct policy instrument rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text, as Book IV, Chapter 2 explicitly examines restraints upon importation as a core protectionist mechanism. The definition accurately reflects Smith's analysis of how these policies function and their economic effects.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is precisely correct, as restraints upon importation are fundamentally regulatory instruments that government uses to control trade flows. This clearly distinguishes them from market mechanisms or production concepts.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation) as it represents regulatory mechanisms that control system boundaries and resource flows. It also has relevance to S4 (intelligence) as these policies reflect responses to perceived environmental threats from foreign competition.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the specific mechanism through which protectionist policies operate to distort market competition. It reveals the structural relationship between trade policy, domestic monopolization, and economic efficiency that is central to Smith's critique.

Evaluation: Restraints Upon Importation

definition_precision — 4.0 / 5.0

The definition is clear and specific, distinguishing between complete prohibitions and high tariffs as mechanisms to create domestic monopolies. It avoids circularity and captures a distinct policy instrument rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text, as Book IV, Chapter 2 explicitly examines restraints upon importation as a core protectionist mechanism. The definition accurately reflects Smith's analysis of how these policies function and their economic effects.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is precisely correct, as restraints upon importation are fundamentally regulatory instruments that government uses to control trade flows. This clearly distinguishes them from market mechanisms or production concepts.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation) as it represents regulatory mechanisms that control system boundaries and resource flows. It also has relevance to S4 (intelligence) as these policies reflect responses to perceived environmental threats from foreign competition.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the specific mechanism through which protectionist policies operate to distort market competition. It reveals the structural relationship between trade policy, domestic monopolization, and economic efficiency that is central to Smith's critique.

3.4 KiB Raw Blame History