feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: variety_of_talents
evaluator: null
evaluated_at: '2026-02-23T06:37:02.344347'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes between natural differences in abilities
and the amplification of these differences through specialization. It precisely
captures Smith's counterintuitive argument that division of labor creates rather
than merely exploits talent differences.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity directly reflects Smith's explicit argument in Book I, Chapter
2, where he states that talent differences are "not upon many occasions so much
the cause as the effect of the division of labour." The concept is clearly grounded
in the source text.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Production" domain is appropriate since this concept directly relates
to how productive capabilities develop through the organization of work and specialization.
It's fundamentally about the production process and human capital formation.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has some relevance to S1 (operations) regarding how capabilities
develop within productive units, and S4 (adaptation) regarding how skills evolve
in response to specialization demands. However, it's more of a developmental principle
than a clear VSM system component.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: "This entity provides significant explanatory power by revealing a key\
\ mechanism in Smith's theory\u2014that specialization itself creates and amplifies\
\ human differences rather than simply utilizing pre-existing ones. It illuminates\
\ how division of labor transforms human capabilities over time."
---
# Evaluation: Variety Of Talents
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes between natural differences in abilities and the amplification of these differences through specialization. It precisely captures Smith's counterintuitive argument that division of labor creates rather than merely exploits talent differences.
## source_grounding — 5.0 / 5.0
This entity directly reflects Smith's explicit argument in Book I, Chapter 2, where he states that talent differences are "not upon many occasions so much the cause as the effect of the division of labour." The concept is clearly grounded in the source text.
## domain_placement — 5.0 / 5.0
The "Production" domain is appropriate since this concept directly relates to how productive capabilities develop through the organization of work and specialization. It's fundamentally about the production process and human capital formation.
## vsm_relevance — 3.0 / 5.0
This entity has some relevance to S1 (operations) regarding how capabilities develop within productive units, and S4 (adaptation) regarding how skills evolve in response to specialization demands. However, it's more of a developmental principle than a clear VSM system component.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by revealing a key mechanism in Smith's theory—that specialization itself creates and amplifies human differences rather than simply utilizing pre-existing ones. It illuminates how division of labor transforms human capabilities over time.