feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: productive_class
evaluator: null
evaluated_at: '2026-02-23T06:10:06.311038'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is precise and non-circular, clearly distinguishing the
productive class by their specific economic function of generating surplus value
beyond their own consumption. It captures a distinct concept with clear boundaries
based on the ability to reproduce and increase societal wealth.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text from Book IV, Chapter
9, where he explicitly discusses the physiocratic classification of society into
productive and unproductive classes. The definition accurately reflects Smith's
presentation of how agricultural systems view cultivators as uniquely productive.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Production" domain assignment is perfectly appropriate since this
concept fundamentally concerns the classification of economic actors based on
their productive capacity. This is a core production theory concept that distinguishes
between different types of economic activity.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity maps most naturally to S1 (primary operations) as it represents
the fundamental value-creating activities of an economic system. However, it's
somewhat abstract as a classification concept rather than a concrete operational
mechanism, making the VSM mapping less direct.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides significant explanatory value by illuminating Smith's
analysis of different economic theories about what constitutes truly productive
economic activity. It reveals the structural relationship between agricultural
surplus generation and national wealth accumulation in physiocratic thinking.
---
# Evaluation: Productive Class
## definition_precision — 4.0 / 5.0
The definition is precise and non-circular, clearly distinguishing the productive class by their specific economic function of generating surplus value beyond their own consumption. It captures a distinct concept with clear boundaries based on the ability to reproduce and increase societal wealth.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text from Book IV, Chapter 9, where he explicitly discusses the physiocratic classification of society into productive and unproductive classes. The definition accurately reflects Smith's presentation of how agricultural systems view cultivators as uniquely productive.
## domain_placement — 5.0 / 5.0
The "Production" domain assignment is perfectly appropriate since this concept fundamentally concerns the classification of economic actors based on their productive capacity. This is a core production theory concept that distinguishes between different types of economic activity.
## vsm_relevance — 3.0 / 5.0
This entity maps most naturally to S1 (primary operations) as it represents the fundamental value-creating activities of an economic system. However, it's somewhat abstract as a classification concept rather than a concrete operational mechanism, making the VSM mapping less direct.
## explanatory_value — 4.0 / 5.0
The entity provides significant explanatory value by illuminating Smith's analysis of different economic theories about what constitutes truly productive economic activity. It reveals the structural relationship between agricultural surplus generation and national wealth accumulation in physiocratic thinking.