Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

public_education_of_professionals

null

2026-02-23T06:12:33.768595

3.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific mechanism - public funding of professional education leading to oversupply and wage depression. It's precise about the causal chain and distinguishes this from general education policy.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book I, Chapter 10, where he explicitly discusses how public funding of clergy education and charitable support for other professions creates oversupply. The "men of letters" reference is particularly authentic to Smith's text.

name	value	max_value	rationale
domain_placement	3.0	5.0	While this affects income distribution, it's more fundamentally about labor market dynamics and wage determination mechanisms. It might be better placed in a "Labor Markets" or "Wage Formation" domain rather than "Distribution."

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity describes a policy intervention and its market effects but doesn't naturally map to VSM systems, which focus on organizational cybernetics. It's more of an economic policy analysis than a systemic organizational function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important structural mechanism showing how well-intentioned public policy can create unintended market distortions. It reveals Smith's insight about the relationship between funding structures and professional labor markets.

Evaluation: Public Education Of Professionals

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific mechanism - public funding of professional education leading to oversupply and wage depression. It's precise about the causal chain and distinguishes this from general education policy.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book I, Chapter 10, where he explicitly discusses how public funding of clergy education and charitable support for other professions creates oversupply. The "men of letters" reference is particularly authentic to Smith's text.

domain_placement — 3.0 / 5.0

While this affects income distribution, it's more fundamentally about labor market dynamics and wage determination mechanisms. It might be better placed in a "Labor Markets" or "Wage Formation" domain rather than "Distribution."

vsm_relevance — 2.0 / 5.0

This entity describes a policy intervention and its market effects but doesn't naturally map to VSM systems, which focus on organizational cybernetics. It's more of an economic policy analysis than a systemic organizational function.

explanatory_value — 4.0 / 5.0

This entity illuminates an important structural mechanism showing how well-intentioned public policy can create unintended market distortions. It reveals Smith's insight about the relationship between funding structures and professional labor markets.

3.1 KiB Raw Blame History