Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

customs_duties

null

2026-02-23T05:04:35.966957

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes customs duties as taxes on imported goods and traces their evolution from taxing merchant profits to revenue generation and trade regulation. It avoids circularity and captures a distinct fiscal instrument with specific characteristics.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's extensive discussion of customs duties in Book V, Chapter 2, where he analyzes their historical development, current functions, and critique of their monopolistic uses. The definition accurately reflects Smith's treatment of the topic.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate as customs duties relate to Smith's broader theoretical framework about taxation, trade, and government revenue. While it could potentially fit in a more specific "Public Finance" or "Trade Policy" domain, the general theory placement captures its systemic importance.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Customs duties have some VSM relevance as they function in S4 (intelligence/adaptation to international trade environment) and S3 (internal regulation of economic flows), but they don't map as clearly to a single VSM system as more structural economic concepts might.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating the mechanism through which governments extract revenue from international trade and regulate economic flows. It reveals structural relations between state power, merchant activity, and market regulation rather than merely naming a surface phenomenon.

Evaluation: Customs Duties

definition_precision — 4.0 / 5.0

The definition clearly distinguishes customs duties as taxes on imported goods and traces their evolution from taxing merchant profits to revenue generation and trade regulation. It avoids circularity and captures a distinct fiscal instrument with specific characteristics.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's extensive discussion of customs duties in Book V, Chapter 2, where he analyzes their historical development, current functions, and critique of their monopolistic uses. The definition accurately reflects Smith's treatment of the topic.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate as customs duties relate to Smith's broader theoretical framework about taxation, trade, and government revenue. While it could potentially fit in a more specific "Public Finance" or "Trade Policy" domain, the general theory placement captures its systemic importance.

vsm_relevance — 3.0 / 5.0

Customs duties have some VSM relevance as they function in S4 (intelligence/adaptation to international trade environment) and S3 (internal regulation of economic flows), but they don't map as clearly to a single VSM system as more structural economic concepts might.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating the mechanism through which governments extract revenue from international trade and regulate economic flows. It reveals structural relations between state power, merchant activity, and market regulation rather than merely naming a surface phenomenon.

3.5 KiB Raw Blame History