Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

treaties_of_commerce

null

2026-02-23T06:34:14.996644

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a distinct concept - formal agreements creating preferential trade privileges through duty exemptions or reductions. It clearly distinguishes treaties of commerce from general trade agreements by specifying their monopolistic effects and asymmetric impacts on trading partners.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis in Book IV, Chapter 6, where he explicitly discusses treaties of commerce and uses the 1703 England-Portugal treaty as a detailed case study. The definition accurately reflects Smith's characterization of these arrangements and their economic effects.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain placement is correct, as treaties of commerce represent formal regulatory mechanisms that govern international trade relationships. These agreements function as institutional constraints that shape market behavior through legal frameworks rather than natural market forces.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Treaties of commerce have some VSM relevance as S4 (intelligence/environmental adaptation) mechanisms, representing how nations attempt to adapt to international competitive pressures through formal agreements. However, they could also be viewed as S3 (internal regulation) tools, making the VSM mapping somewhat ambiguous.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides strong explanatory value by illuminating the structural mechanism through which nations create artificial competitive advantages and distort natural trade patterns. It reveals how formal agreements can systematically benefit one party while harming another, demonstrating Smith's broader critique of mercantile policies.

Evaluation: Treaties Of Commerce

definition_precision — 4.0 / 5.0

The definition is precise and captures a distinct concept - formal agreements creating preferential trade privileges through duty exemptions or reductions. It clearly distinguishes treaties of commerce from general trade agreements by specifying their monopolistic effects and asymmetric impacts on trading partners.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis in Book IV, Chapter 6, where he explicitly discusses treaties of commerce and uses the 1703 England-Portugal treaty as a detailed case study. The definition accurately reflects Smith's characterization of these arrangements and their economic effects.

domain_placement — 5.0 / 5.0

The "Regulation" domain placement is correct, as treaties of commerce represent formal regulatory mechanisms that govern international trade relationships. These agreements function as institutional constraints that shape market behavior through legal frameworks rather than natural market forces.

vsm_relevance — 3.0 / 5.0

Treaties of commerce have some VSM relevance as S4 (intelligence/environmental adaptation) mechanisms, representing how nations attempt to adapt to international competitive pressures through formal agreements. However, they could also be viewed as S3 (internal regulation) tools, making the VSM mapping somewhat ambiguous.

explanatory_value — 4.0 / 5.0

This entity provides strong explanatory value by illuminating the structural mechanism through which nations create artificial competitive advantages and distort natural trade patterns. It reveals how formal agreements can systematically benefit one party while harming another, demonstrating Smith's broader critique of mercantile policies.

3.8 KiB Raw Blame History