Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

free_ports

null

2026-02-23T05:31:18.065165

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes free ports as specific designated locations with minimal customs duties, contrasting them with broader national trade policies. It avoids circularity and captures a distinct institutional arrangement rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	The entity is directly grounded in Smith's discussion in Book IV, Chapter 3, where he explicitly examines free ports as examples of localized free trade policies. The context accurately reflects Smith's observation about European towns functioning as free ports while no entire countries adopt this approach.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since free ports are fundamentally about facilitating trade and commercial exchange through reduced regulatory barriers. This represents a core mechanism of market exchange rather than production, distribution, or consumption.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Free ports have some VSM relevance as they represent a coordination mechanism (S2) that manages trade flows and reduces friction between different regulatory environments. However, they are primarily a policy tool rather than a core systemic function, making the VSM mapping somewhat indirect.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important structural mechanism showing how localized free trade can coexist with broader protectionist policies, demonstrating Smith's argument about the benefits of reduced trade barriers. It reveals the institutional innovation of creating trade enclaves within otherwise restricted economies.

Evaluation: Free Ports

definition_precision — 4.0 / 5.0

The definition clearly distinguishes free ports as specific designated locations with minimal customs duties, contrasting them with broader national trade policies. It avoids circularity and captures a distinct institutional arrangement rather than a vague concept.

source_grounding — 5.0 / 5.0

The entity is directly grounded in Smith's discussion in Book IV, Chapter 3, where he explicitly examines free ports as examples of localized free trade policies. The context accurately reflects Smith's observation about European towns functioning as free ports while no entire countries adopt this approach.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since free ports are fundamentally about facilitating trade and commercial exchange through reduced regulatory barriers. This represents a core mechanism of market exchange rather than production, distribution, or consumption.

vsm_relevance — 3.0 / 5.0

Free ports have some VSM relevance as they represent a coordination mechanism (S2) that manages trade flows and reduces friction between different regulatory environments. However, they are primarily a policy tool rather than a core systemic function, making the VSM mapping somewhat indirect.

explanatory_value — 4.0 / 5.0

This entity illuminates an important structural mechanism showing how localized free trade can coexist with broader protectionist policies, demonstrating Smith's argument about the benefits of reduced trade barriers. It reveals the institutional innovation of creating trade enclaves within otherwise restricted economies.

3.6 KiB Raw Blame History