feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: urban_rural_reciprocity
evaluator: null
evaluated_at: '2026-02-23T06:36:09.322206'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly articulates a specific economic relationship with
distinct components (urban markets/manufacturing vs. rural food/raw materials)
and identifies the key mechanism of mutual dependence. It avoids circularity and
captures a concrete structural relationship rather than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's analysis in Book III, Chapter
3, where he explicitly discusses the interdependent relationship between towns
and countryside and how their mutual development drives economic progress. The
concept reflects Smith's actual argument rather than imposing external frameworks.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since this entity describes
a fundamental pattern of economic exchange and trade relationships between different
economic sectors. The reciprocal trading relationship is the core mechanism that
defines this concept.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has some VSM relevance as it describes coordination mechanisms
between different economic subsystems (S2) and could relate to how economic systems
maintain internal regulation (S3). However, it's more of a structural relationship
pattern than a clear VSM operational component.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by illuminating how
economic development occurs through structural interdependence rather than isolated
growth, revealing the mechanism by which urban and rural sectors mutually stimulate
each other's development. It explains a key driver of Smith's theory of economic
progress.
---
# Evaluation: Urban Rural Reciprocity
## definition_precision — 4.0 / 5.0
The definition clearly articulates a specific economic relationship with distinct components (urban markets/manufacturing vs. rural food/raw materials) and identifies the key mechanism of mutual dependence. It avoids circularity and captures a concrete structural relationship rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's analysis in Book III, Chapter 3, where he explicitly discusses the interdependent relationship between towns and countryside and how their mutual development drives economic progress. The concept reflects Smith's actual argument rather than imposing external frameworks.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since this entity describes a fundamental pattern of economic exchange and trade relationships between different economic sectors. The reciprocal trading relationship is the core mechanism that defines this concept.
## vsm_relevance — 3.0 / 5.0
This entity has some VSM relevance as it describes coordination mechanisms between different economic subsystems (S2) and could relate to how economic systems maintain internal regulation (S3). However, it's more of a structural relationship pattern than a clear VSM operational component.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by illuminating how economic development occurs through structural interdependence rather than isolated growth, revealing the mechanism by which urban and rural sectors mutually stimulate each other's development. It explains a key driver of Smith's theory of economic progress.