Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

prohibition_of_exportation

null

2026-02-23T06:11:13.527699

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes prohibition of exportation as government bans on specific goods (particularly raw materials) with stated economic intentions. It avoids circularity and captures a distinct policy mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis in Book IV, Chapter 8, where he specifically examines export prohibitions on materials like wool and raw hides. The definition accurately reflects Smith's treatment of these policies and their economic rationale.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain assignment, as export prohibitions are clearly government regulatory interventions in markets. This fits perfectly within Smith's broader analysis of mercantile policies and trade restrictions.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps reasonably well to S3 (internal regulation) as it represents government control mechanisms over economic flows. However, it could also relate to S4 (environmental adaptation) regarding international trade responses, making the VSM placement somewhat ambiguous.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism in Smith's critique of mercantilism—how governments attempt to manipulate domestic production advantages through trade restrictions. It reveals the structural tension between protecting domestic industries and achieving overall economic efficiency.

Evaluation: Prohibition Of Exportation

definition_precision — 4.0 / 5.0

The definition clearly distinguishes prohibition of exportation as government bans on specific goods (particularly raw materials) with stated economic intentions. It avoids circularity and captures a distinct policy mechanism rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis in Book IV, Chapter 8, where he specifically examines export prohibitions on materials like wool and raw hides. The definition accurately reflects Smith's treatment of these policies and their economic rationale.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain assignment, as export prohibitions are clearly government regulatory interventions in markets. This fits perfectly within Smith's broader analysis of mercantile policies and trade restrictions.

vsm_relevance — 3.0 / 5.0

This entity maps reasonably well to S3 (internal regulation) as it represents government control mechanisms over economic flows. However, it could also relate to S4 (environmental adaptation) regarding international trade responses, making the VSM placement somewhat ambiguous.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism in Smith's critique of mercantilism—how governments attempt to manipulate domestic production advantages through trade restrictions. It reveals the structural tension between protecting domestic industries and achieving overall economic efficiency.

3.3 KiB Raw Blame History