feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: transportation_cost_differential
evaluator: null
evaluated_at: '2026-02-23T06:33:33.461698'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes between different transportation
modes and their cost implications, with specific focus on water vs. land carriage.
It avoids circularity and captures a distinct economic concept that directly affects
market dynamics.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's detailed calculations comparing
the resource requirements of different transportation methods (100 men + 400 horses
for land vs. 6-8 men + ship for water). The concept emerges naturally from Smith's
analysis rather than being imposed from external frameworks.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since transportation cost
differentials directly determine which goods can be profitably traded and over
what distances. This is fundamentally about the mechanics and feasibility of market
exchange.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has some relevance to S1 (operational constraints on primary
activities) and S4 (environmental factors affecting system adaptation), but it's
more of an environmental constraint than a core VSM system component. It influences
system behavior without being a control mechanism itself.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory power by illuminating the
fundamental mechanism that determines market extent and specialization patterns.
It explains why certain trade relationships exist while others don't, making it
a key structural determinant rather than just a surface observation.
---
# Evaluation: Transportation Cost Differential
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes between different transportation modes and their cost implications, with specific focus on water vs. land carriage. It avoids circularity and captures a distinct economic concept that directly affects market dynamics.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's detailed calculations comparing the resource requirements of different transportation methods (100 men + 400 horses for land vs. 6-8 men + ship for water). The concept emerges naturally from Smith's analysis rather than being imposed from external frameworks.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since transportation cost differentials directly determine which goods can be profitably traded and over what distances. This is fundamentally about the mechanics and feasibility of market exchange.
## vsm_relevance — 3.0 / 5.0
This entity has some relevance to S1 (operational constraints on primary activities) and S4 (environmental factors affecting system adaptation), but it's more of an environmental constraint than a core VSM system component. It influences system behavior without being a control mechanism itself.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory power by illuminating the fundamental mechanism that determines market extent and specialization patterns. It explains why certain trade relationships exist while others don't, making it a key structural determinant rather than just a surface observation.