Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

variety_of_talents

null

2026-02-23T06:37:02.344347

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes between natural differences in abilities and the amplification of these differences through specialization. It precisely captures Smith's counterintuitive argument that division of labor creates rather than merely exploits talent differences.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity directly reflects Smith's explicit argument in Book I, Chapter 2, where he states that talent differences are "not upon many occasions so much the cause as the effect of the division of labour." The concept is clearly grounded in the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain is appropriate since this concept directly relates to how productive capabilities develop through the organization of work and specialization. It's fundamentally about the production process and human capital formation.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has some relevance to S1 (operations) regarding how capabilities develop within productive units, and S4 (adaptation) regarding how skills evolve in response to specialization demands. However, it's more of a developmental principle than a clear VSM system component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by revealing a key mechanism in Smith's theory—that specialization itself creates and amplifies human differences rather than simply utilizing pre-existing ones. It illuminates how division of labor transforms human capabilities over time.

Evaluation: Variety Of Talents

definition_precision — 4.0 / 5.0

The definition clearly distinguishes between natural differences in abilities and the amplification of these differences through specialization. It precisely captures Smith's counterintuitive argument that division of labor creates rather than merely exploits talent differences.

source_grounding — 5.0 / 5.0

This entity directly reflects Smith's explicit argument in Book I, Chapter 2, where he states that talent differences are "not upon many occasions so much the cause as the effect of the division of labour." The concept is clearly grounded in the source text.

domain_placement — 5.0 / 5.0

The "Production" domain is appropriate since this concept directly relates to how productive capabilities develop through the organization of work and specialization. It's fundamentally about the production process and human capital formation.

vsm_relevance — 3.0 / 5.0

This entity has some relevance to S1 (operations) regarding how capabilities develop within productive units, and S4 (adaptation) regarding how skills evolve in response to specialization demands. However, it's more of a developmental principle than a clear VSM system component.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by revealing a key mechanism in Smith's theory—that specialization itself creates and amplifies human differences rather than simply utilizing pre-existing ones. It illuminates how division of labor transforms human capabilities over time.

3.4 KiB Raw Blame History