feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: productive_expenses
evaluator: null
evaluated_at: '2026-02-23T06:10:15.274836'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is quite precise, clearly distinguishing productive expenses
as those that generate surplus value beyond replacement costs, with specific examples
from agricultural contexts. The distinction between replacement value and surplus
generation creates a clear conceptual boundary.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's text from Book IV, Chapter
9, where he explicitly discusses the Physiocratic distinction between productive
and unproductive expenses in agricultural systems. The entity accurately reflects
Smith's presentation of this economic theory.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Production" domain assignment is exactly correct, as this concept
deals fundamentally with the productive capacity of different types of economic
expenditures. This is a core production theory concept distinguishing value-generating
from value-consuming expenses.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S1 (primary
operations) as it concerns the fundamental productive activities that generate
organizational surplus. However, it's somewhat abstract as an expense classification
rather than an operational mechanism.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides strong explanatory value by illuminating the mechanism
through which certain expenses generate surplus value rather than merely consuming
resources. This distinction is crucial for understanding how economic systems
create wealth versus merely circulating it.
---
# Evaluation: Productive Expenses
## definition_precision — 4.0 / 5.0
The definition is quite precise, clearly distinguishing productive expenses as those that generate surplus value beyond replacement costs, with specific examples from agricultural contexts. The distinction between replacement value and surplus generation creates a clear conceptual boundary.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's text from Book IV, Chapter 9, where he explicitly discusses the Physiocratic distinction between productive and unproductive expenses in agricultural systems. The entity accurately reflects Smith's presentation of this economic theory.
## domain_placement — 5.0 / 5.0
The "Production" domain assignment is exactly correct, as this concept deals fundamentally with the productive capacity of different types of economic expenditures. This is a core production theory concept distinguishing value-generating from value-consuming expenses.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it concerns the fundamental productive activities that generate organizational surplus. However, it's somewhat abstract as an expense classification rather than an operational mechanism.
## explanatory_value — 4.0 / 5.0
The entity provides strong explanatory value by illuminating the mechanism through which certain expenses generate surplus value rather than merely consuming resources. This distinction is crucial for understanding how economic systems create wealth versus merely circulating it.