Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

re_exportation_drawback

null

2026-02-23T06:15:25.454381

4.6

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly explaining the specific mechanism of tax refunds on re-exported goods and its purpose in preventing double taxation. It captures a distinct administrative and economic concept with clear operational boundaries.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Book IV, Chapter 4, where Smith explicitly discusses drawbacks on re-exportation as part of his analysis of the mercantile system's trade mechanisms. The concept directly reflects Smith's detailed examination of how duties and drawbacks function in international commerce.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain placement is entirely appropriate, as re-exportation drawbacks are fundamentally about facilitating international trade flows and removing barriers to cross-border commerce. This fits perfectly within the broader category of exchange mechanisms and trade facilitation.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as it prevents trade disruptions and maintains smooth commercial flows, and also to S3 (internal regulation) as it represents a specific administrative mechanism for managing trade policy. The dual mapping shows clear VSM relevance.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating how tax policy mechanisms can either facilitate or hinder international trade competitiveness. It reveals the structural relationship between domestic taxation and international commerce, though it represents a more tactical than strategic concept.

Evaluation: Re Exportation Drawback

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly explaining the specific mechanism of tax refunds on re-exported goods and its purpose in preventing double taxation. It captures a distinct administrative and economic concept with clear operational boundaries.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Book IV, Chapter 4, where Smith explicitly discusses drawbacks on re-exportation as part of his analysis of the mercantile system's trade mechanisms. The concept directly reflects Smith's detailed examination of how duties and drawbacks function in international commerce.

domain_placement — 5.0 / 5.0

The "Exchange" domain placement is entirely appropriate, as re-exportation drawbacks are fundamentally about facilitating international trade flows and removing barriers to cross-border commerce. This fits perfectly within the broader category of exchange mechanisms and trade facilitation.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as it prevents trade disruptions and maintains smooth commercial flows, and also to S3 (internal regulation) as it represents a specific administrative mechanism for managing trade policy. The dual mapping shows clear VSM relevance.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating how tax policy mechanisms can either facilitate or hinder international trade competitiveness. It reveals the structural relationship between domestic taxation and international commerce, though it represents a more tactical than strategic concept.

3.6 KiB Raw Blame History