feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,65 @@
|
||||
---
|
||||
entity_slug: free_ports
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T05:31:18.065165'
|
||||
overall_score: 4.2
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly distinguishes free ports as specific designated
|
||||
locations with minimal customs duties, contrasting them with broader national
|
||||
trade policies. It avoids circularity and captures a distinct institutional arrangement
|
||||
rather than a vague concept.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The entity is directly grounded in Smith's discussion in Book IV, Chapter
|
||||
3, where he explicitly examines free ports as examples of localized free trade
|
||||
policies. The context accurately reflects Smith's observation about European towns
|
||||
functioning as free ports while no entire countries adopt this approach.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Exchange" domain is perfectly appropriate since free ports are fundamentally
|
||||
about facilitating trade and commercial exchange through reduced regulatory barriers.
|
||||
This represents a core mechanism of market exchange rather than production, distribution,
|
||||
or consumption.
|
||||
- name: vsm_relevance
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: Free ports have some VSM relevance as they represent a coordination mechanism
|
||||
(S2) that manages trade flows and reduces friction between different regulatory
|
||||
environments. However, they are primarily a policy tool rather than a core systemic
|
||||
function, making the VSM mapping somewhat indirect.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity illuminates an important structural mechanism showing how
|
||||
localized free trade can coexist with broader protectionist policies, demonstrating
|
||||
Smith's argument about the benefits of reduced trade barriers. It reveals the
|
||||
institutional innovation of creating trade enclaves within otherwise restricted
|
||||
economies.
|
||||
---
|
||||
|
||||
# Evaluation: Free Ports
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly distinguishes free ports as specific designated locations with minimal customs duties, contrasting them with broader national trade policies. It avoids circularity and captures a distinct institutional arrangement rather than a vague concept.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
The entity is directly grounded in Smith's discussion in Book IV, Chapter 3, where he explicitly examines free ports as examples of localized free trade policies. The context accurately reflects Smith's observation about European towns functioning as free ports while no entire countries adopt this approach.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Exchange" domain is perfectly appropriate since free ports are fundamentally about facilitating trade and commercial exchange through reduced regulatory barriers. This represents a core mechanism of market exchange rather than production, distribution, or consumption.
|
||||
|
||||
## vsm_relevance — 3.0 / 5.0
|
||||
|
||||
Free ports have some VSM relevance as they represent a coordination mechanism (S2) that manages trade flows and reduces friction between different regulatory environments. However, they are primarily a policy tool rather than a core systemic function, making the VSM mapping somewhat indirect.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
This entity illuminates an important structural mechanism showing how localized free trade can coexist with broader protectionist policies, demonstrating Smith's argument about the benefits of reduced trade barriers. It reveals the institutional innovation of creating trade enclaves within otherwise restricted economies.
|
||||
Reference in New Issue
Block a user