markitect-main/examples/infospace-with-history/output/evaluations/navigation_acts.md at 9e8d73fa7db3492f33480f0a715f1dd2a331bbf3

Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

navigation_acts

null

2026-02-23T06:01:35.835468

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly specifying the ownership, manning, and construction requirements for ships in colonial trade. It captures a distinct regulatory mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book IV, Chapter 8, where he extensively analyzes navigation acts as prime examples of mercantile system regulations. The definition accurately reflects Smith's treatment of these policies and their effects.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is perfectly appropriate, as navigation acts are quintessential government trade regulations. This placement correctly categorizes the entity within the broader framework of state intervention in commerce.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Navigation acts map well to S3 (internal regulation) as they represent systematic control mechanisms over trade flows, and partially to S4 (intelligence/adaptation) as they respond to perceived threats to national maritime power. The regulatory nature gives it clear VSM relevance.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the specific mechanism through which mercantile systems prioritize producer interests over efficiency. It demonstrates the structural tension between national power objectives and economic optimization that Smith critiques throughout his work.

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly specifying the ownership, manning, and construction requirements for ships in colonial trade. It captures a distinct regulatory mechanism rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book IV, Chapter 8, where he extensively analyzes navigation acts as prime examples of mercantile system regulations. The definition accurately reflects Smith's treatment of these policies and their effects.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is perfectly appropriate, as navigation acts are quintessential government trade regulations. This placement correctly categorizes the entity within the broader framework of state intervention in commerce.

vsm_relevance — 4.0 / 5.0

Navigation acts map well to S3 (internal regulation) as they represent systematic control mechanisms over trade flows, and partially to S4 (intelligence/adaptation) as they respond to perceived threats to national maritime power. The regulatory nature gives it clear VSM relevance.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the specific mechanism through which mercantile systems prioritize producer interests over efficiency. It demonstrates the structural tension between national power objectives and economic optimization that Smith critiques throughout his work.

3.3 KiB Raw Blame History

Evaluation: Navigation Acts