feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: farmer_s_profit
evaluator: null
evaluated_at: '2026-02-23T05:27:50.141684'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes farmer's profit as the return to
agricultural entrepreneurs for capital use and management, specifying it must
compensate for risk/effort and provide competitive returns. It avoids circularity
and captures a distinct economic concept separate from rent or wages.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Book I, Chapter 11 where Smith extensively
analyzes agricultural profits, their determinants, and their relationship to land
productivity and cultivation efficiency. The definition accurately reflects Smith's
treatment of farming as entrepreneurial activity requiring capital investment.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Distribution" is the correct domain placement as this concerns how
the returns from agricultural production are allocated to the farming entrepreneur,
fitting perfectly within Smith''s analysis of how national wealth is distributed
among different factors of production.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S1 (primary
operations) as it represents returns from core productive activities in agriculture.
However, it's more of an outcome measure than a structural system component, making
the VSM mapping somewhat indirect.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides strong explanatory value by illuminating the mechanism
through which agricultural investment is incentivized and sustained, showing how
profit requirements drive cultivation decisions and agricultural improvement.
It reveals the structural relationship between risk, capital deployment, and returns
in farming.
---
# Evaluation: Farmer S Profit
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes farmer's profit as the return to agricultural entrepreneurs for capital use and management, specifying it must compensate for risk/effort and provide competitive returns. It avoids circularity and captures a distinct economic concept separate from rent or wages.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Book I, Chapter 11 where Smith extensively analyzes agricultural profits, their determinants, and their relationship to land productivity and cultivation efficiency. The definition accurately reflects Smith's treatment of farming as entrepreneurial activity requiring capital investment.
## domain_placement — 5.0 / 5.0
"Distribution" is the correct domain placement as this concerns how the returns from agricultural production are allocated to the farming entrepreneur, fitting perfectly within Smith's analysis of how national wealth is distributed among different factors of production.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it represents returns from core productive activities in agriculture. However, it's more of an outcome measure than a structural system component, making the VSM mapping somewhat indirect.
## explanatory_value — 4.0 / 5.0
The entity provides strong explanatory value by illuminating the mechanism through which agricultural investment is incentivized and sustained, showing how profit requirements drive cultivation decisions and agricultural improvement. It reveals the structural relationship between risk, capital deployment, and returns in farming.