feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: improvement_of_the_country
evaluator: null
evaluated_at: '2026-02-23T05:36:32.453434'
overall_score: 3.4
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a distinct process of rural transformation but
is somewhat sprawling, combining multiple mechanisms (cultivation, infrastructure,
commercial wealth flows) without clearly delineating the core concept. It avoids
circularity but could be more focused on what specifically constitutes "improvement."
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity appears well-grounded in Smith's actual argument from Book
III, Chapter 4 about how urban commerce transforms rural areas. The specific mechanisms
mentioned (wealthy merchants becoming country gentlemen, urban wealth funding
rural improvements) align with Smith's historical analysis.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: Placement in "Production" domain is appropriate since this concerns the
enhancement of agricultural productivity and land value. The entity fundamentally
deals with improving the productive capacity of rural lands through better cultivation
and management.
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This entity represents a high-level outcome or emergent property rather
than a specific systemic function, making it difficult to map to particular VSM
systems. It's more of a meta-result that spans multiple systems rather than belonging
naturally to S1-S5.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides significant explanatory value by identifying the
end result of Smith's three-mechanism theory of how commerce transforms rural
society. It illuminates the structural relationship between urban wealth and rural
development, showing how commercial activity ultimately reshapes the countryside.
---
# Evaluation: Improvement Of The Country
## definition_precision — 3.0 / 5.0
The definition captures a distinct process of rural transformation but is somewhat sprawling, combining multiple mechanisms (cultivation, infrastructure, commercial wealth flows) without clearly delineating the core concept. It avoids circularity but could be more focused on what specifically constitutes "improvement."
## source_grounding — 4.0 / 5.0
This entity appears well-grounded in Smith's actual argument from Book III, Chapter 4 about how urban commerce transforms rural areas. The specific mechanisms mentioned (wealthy merchants becoming country gentlemen, urban wealth funding rural improvements) align with Smith's historical analysis.
## domain_placement — 4.0 / 5.0
Placement in "Production" domain is appropriate since this concerns the enhancement of agricultural productivity and land value. The entity fundamentally deals with improving the productive capacity of rural lands through better cultivation and management.
## vsm_relevance — 2.0 / 5.0
This entity represents a high-level outcome or emergent property rather than a specific systemic function, making it difficult to map to particular VSM systems. It's more of a meta-result that spans multiple systems rather than belonging naturally to S1-S5.
## explanatory_value — 4.0 / 5.0
The entity provides significant explanatory value by identifying the end result of Smith's three-mechanism theory of how commerce transforms rural society. It illuminates the structural relationship between urban wealth and rural development, showing how commercial activity ultimately reshapes the countryside.