Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

apprenticeships

null

2026-02-23T00:34:30.485509

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly specifying the key elements: fixed term (seven years), master-apprentice relationship, labor ownership, training provision, and barrier-to-entry effects. It avoids circularity and captures the essential structural features of the apprenticeship system as an economic institution.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is strongly grounded in Smith's actual analysis in Book I, Chapter 10, where he extensively critiques apprenticeships as artificial restrictions on labor mobility and competition. The definition accurately reflects Smith's specific concerns about seven-year terms and their role in creating market inequalities.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain placement is exactly correct, as Smith treats apprenticeships as a prime example of how European policy artificially regulates and restricts natural market operations. This fits perfectly within his broader critique of regulatory interventions that distort economic outcomes.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Apprenticeships map reasonably well to S2 (coordination) as they represent a regulatory mechanism that coordinates labor market entry, but they also touch on S3 (internal regulation) aspects. The mapping is not as natural or clear-cut as some other economic mechanisms, making it moderately VSM-relevant.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides strong explanatory value by illuminating a specific mechanism through which established interests restrict competition and maintain artificial wage premiums. It demonstrates how seemingly beneficial institutions can actually create structural inequalities and market distortions.

Evaluation: Apprenticeships

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly specifying the key elements: fixed term (seven years), master-apprentice relationship, labor ownership, training provision, and barrier-to-entry effects. It avoids circularity and captures the essential structural features of the apprenticeship system as an economic institution.

source_grounding — 5.0 / 5.0

This entity is strongly grounded in Smith's actual analysis in Book I, Chapter 10, where he extensively critiques apprenticeships as artificial restrictions on labor mobility and competition. The definition accurately reflects Smith's specific concerns about seven-year terms and their role in creating market inequalities.

domain_placement — 5.0 / 5.0

The "Regulation" domain placement is exactly correct, as Smith treats apprenticeships as a prime example of how European policy artificially regulates and restricts natural market operations. This fits perfectly within his broader critique of regulatory interventions that distort economic outcomes.

vsm_relevance — 3.0 / 5.0

Apprenticeships map reasonably well to S2 (coordination) as they represent a regulatory mechanism that coordinates labor market entry, but they also touch on S3 (internal regulation) aspects. The mapping is not as natural or clear-cut as some other economic mechanisms, making it moderately VSM-relevant.

explanatory_value — 4.0 / 5.0

This entity provides strong explanatory value by illuminating a specific mechanism through which established interests restrict competition and maintain artificial wage premiums. It demonstrates how seemingly beneficial institutions can actually create structural inequalities and market distortions.

3.8 KiB Raw Blame History