Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

principal_clerk

null

2026-02-23T06:08:47.862735

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific role - the chief administrative officer who oversees operations and directs inspection/direction labor. It distinguishes this from ownership and establishes it as part of the professional management class, making it a distinct concept rather than a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 6, where he explicitly discusses how the labor of inspection and direction can be separated from capital ownership. The context accurately reflects Smith's analysis of the distinction between wages paid to clerks and profits belonging to capital owners.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is correct, as this role relates directly to the organization and management of productive activities. The principal clerk represents a key element in the division of labor within production processes that Smith analyzes.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to VSM System 3 (internal regulation/audit) as it represents the management function that monitors and coordinates internal operations. It could also relate to S2 (coordination) in its role of directing labor and preventing operational conflicts.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important structural mechanism in Smith's analysis - the separation of management labor from capital ownership. It helps explain how complex enterprises can function with professional managers who receive wages while owners capture profits, demonstrating the evolution of organizational forms.

Evaluation: Principal Clerk

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific role - the chief administrative officer who oversees operations and directs inspection/direction labor. It distinguishes this from ownership and establishes it as part of the professional management class, making it a distinct concept rather than a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 6, where he explicitly discusses how the labor of inspection and direction can be separated from capital ownership. The context accurately reflects Smith's analysis of the distinction between wages paid to clerks and profits belonging to capital owners.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is correct, as this role relates directly to the organization and management of productive activities. The principal clerk represents a key element in the division of labor within production processes that Smith analyzes.

vsm_relevance — 4.0 / 5.0

This entity maps well to VSM System 3 (internal regulation/audit) as it represents the management function that monitors and coordinates internal operations. It could also relate to S2 (coordination) in its role of directing labor and preventing operational conflicts.

explanatory_value — 4.0 / 5.0

This entity illuminates an important structural mechanism in Smith's analysis - the separation of management labor from capital ownership. It helps explain how complex enterprises can function with professional managers who receive wages while owners capture profits, demonstrating the evolution of organizational forms.

3.6 KiB Raw Blame History