feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: free_ports
evaluator: null
evaluated_at: '2026-02-23T05:31:18.065165'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes free ports as specific designated
locations with minimal customs duties, contrasting them with broader national
trade policies. It avoids circularity and captures a distinct institutional arrangement
rather than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: The entity is directly grounded in Smith's discussion in Book IV, Chapter
3, where he explicitly examines free ports as examples of localized free trade
policies. The context accurately reflects Smith's observation about European towns
functioning as free ports while no entire countries adopt this approach.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since free ports are fundamentally
about facilitating trade and commercial exchange through reduced regulatory barriers.
This represents a core mechanism of market exchange rather than production, distribution,
or consumption.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: Free ports have some VSM relevance as they represent a coordination mechanism
(S2) that manages trade flows and reduces friction between different regulatory
environments. However, they are primarily a policy tool rather than a core systemic
function, making the VSM mapping somewhat indirect.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity illuminates an important structural mechanism showing how
localized free trade can coexist with broader protectionist policies, demonstrating
Smith's argument about the benefits of reduced trade barriers. It reveals the
institutional innovation of creating trade enclaves within otherwise restricted
economies.
---
# Evaluation: Free Ports
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes free ports as specific designated locations with minimal customs duties, contrasting them with broader national trade policies. It avoids circularity and captures a distinct institutional arrangement rather than a vague concept.
## source_grounding — 5.0 / 5.0
The entity is directly grounded in Smith's discussion in Book IV, Chapter 3, where he explicitly examines free ports as examples of localized free trade policies. The context accurately reflects Smith's observation about European towns functioning as free ports while no entire countries adopt this approach.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since free ports are fundamentally about facilitating trade and commercial exchange through reduced regulatory barriers. This represents a core mechanism of market exchange rather than production, distribution, or consumption.
## vsm_relevance — 3.0 / 5.0
Free ports have some VSM relevance as they represent a coordination mechanism (S2) that manages trade flows and reduces friction between different regulatory environments. However, they are primarily a policy tool rather than a core systemic function, making the VSM mapping somewhat indirect.
## explanatory_value — 4.0 / 5.0
This entity illuminates an important structural mechanism showing how localized free trade can coexist with broader protectionist policies, demonstrating Smith's argument about the benefits of reduced trade barriers. It reveals the institutional innovation of creating trade enclaves within otherwise restricted economies.