feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,60 @@
---
entity_slug: capital_of_the_farmer
evaluator: null
evaluated_at: '2026-02-23T04:41:02.632610'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is clear and specific, identifying distinct components
(seeds, equipment, livestock, labor funds) rather than using vague terms. It captures
a well-bounded economic concept of agricultural working capital.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does discuss farmer capital in the context of bounties and agricultural
investment in Book IV, Chapter 5. The entity accurately reflects his analysis
of how farmer capital must be compensated for agricultural trade to be beneficial.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Production" is the correct domain assignment since this concerns the
capital inputs necessary for agricultural production processes. This is fundamentally
about the productive capacity of the economy.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This maps well to S1 (primary operations) as it represents the essential
resources needed for agricultural production operations. It could also relate
to S3 regarding resource allocation and management within the agricultural sector.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity illuminates an important mechanism in Smith's analysis - how
capital investment requirements affect the true economics of agricultural bounties
and trade policies. It helps explain the structural relationship between government
incentives and private investment.
---
# Evaluation: Capital Of The Farmer
## definition_precision — 4.0 / 5.0
The definition is clear and specific, identifying distinct components (seeds, equipment, livestock, labor funds) rather than using vague terms. It captures a well-bounded economic concept of agricultural working capital.
## source_grounding — 4.0 / 5.0
Smith does discuss farmer capital in the context of bounties and agricultural investment in Book IV, Chapter 5. The entity accurately reflects his analysis of how farmer capital must be compensated for agricultural trade to be beneficial.
## domain_placement — 5.0 / 5.0
"Production" is the correct domain assignment since this concerns the capital inputs necessary for agricultural production processes. This is fundamentally about the productive capacity of the economy.
## vsm_relevance — 4.0 / 5.0
This maps well to S1 (primary operations) as it represents the essential resources needed for agricultural production operations. It could also relate to S3 regarding resource allocation and management within the agricultural sector.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important mechanism in Smith's analysis - how capital investment requirements affect the true economics of agricultural bounties and trade policies. It helps explain the structural relationship between government incentives and private investment.