Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

enumerated_commodities

null

2026-02-23T05:23:36.157100

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise, clearly identifying specific colonial products (tobacco, sugar, cotton, indigo, naval stores) and their exact regulatory constraint (exportable only to the mother country). It captures a distinct legal-economic category rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed analysis of the Navigation Acts in Book IV, Chapter 7, where he extensively discusses these specific commodity restrictions. The concept emerges clearly from Smith's critique of mercantilist colonial policy.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is perfectly appropriate, as enumerated commodities represent a specific regulatory mechanism within the broader mercantilist system. This is fundamentally about trade restrictions and legal constraints on commerce.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation) as it represents a control mechanism within the imperial economic system, and partially to S2 (coordination) as it channels colonial trade flows. The regulatory nature gives it clear VSM relevance.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the specific mechanism through which mercantilist policy constrained colonial autonomy and market efficiency. It reveals how regulatory categories created artificial monopolies and distorted natural trade patterns.

Evaluation: Enumerated Commodities

definition_precision — 5.0 / 5.0

The definition is highly precise, clearly identifying specific colonial products (tobacco, sugar, cotton, indigo, naval stores) and their exact regulatory constraint (exportable only to the mother country). It captures a distinct legal-economic category rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed analysis of the Navigation Acts in Book IV, Chapter 7, where he extensively discusses these specific commodity restrictions. The concept emerges clearly from Smith's critique of mercantilist colonial policy.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is perfectly appropriate, as enumerated commodities represent a specific regulatory mechanism within the broader mercantilist system. This is fundamentally about trade restrictions and legal constraints on commerce.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation) as it represents a control mechanism within the imperial economic system, and partially to S2 (coordination) as it channels colonial trade flows. The regulatory nature gives it clear VSM relevance.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the specific mechanism through which mercantilist policy constrained colonial autonomy and market efficiency. It reveals how regulatory categories created artificial monopolies and distorted natural trade patterns.

3.3 KiB Raw Blame History