Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bleacher

null

2026-02-23T04:38:22.796303

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and specific, clearly identifying a bleacher as a worker who whitens linen through chemical or natural processes. It captures a distinct occupational role rather than being vague or circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in "The Wealth of Nations" as Smith frequently discusses various specialized trades and manufacturing processes, including textile workers like bleachers, as examples of division of labor and economic specialization.

name	value	max_value	rationale
domain_placement	4.0	5.0	The entity fits well within the economic domain of labor specialization and manufacturing processes that Smith analyzes. It represents a concrete example of the division of labor in textile production.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps clearly to S1 (primary operations) as it represents a specific operational function within the textile production system. It could also relate to S2 in terms of coordination within the broader manufacturing process.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides good explanatory value by illustrating Smith's key concepts of division of labor and specialization in manufacturing. It demonstrates how complex production processes are broken down into specialized roles, which is central to Smith's economic analysis.

Evaluation: Bleacher

definition_precision — 4.0 / 5.0

The definition is precise and specific, clearly identifying a bleacher as a worker who whitens linen through chemical or natural processes. It captures a distinct occupational role rather than being vague or circular.

source_grounding — 5.0 / 5.0

This entity is well-grounded in "The Wealth of Nations" as Smith frequently discusses various specialized trades and manufacturing processes, including textile workers like bleachers, as examples of division of labor and economic specialization.

domain_placement — 4.0 / 5.0

The entity fits well within the economic domain of labor specialization and manufacturing processes that Smith analyzes. It represents a concrete example of the division of labor in textile production.

vsm_relevance — 5.0 / 5.0

This entity maps clearly to S1 (primary operations) as it represents a specific operational function within the textile production system. It could also relate to S2 in terms of coordination within the broader manufacturing process.

explanatory_value — 4.0 / 5.0

The entity provides good explanatory value by illustrating Smith's key concepts of division of labor and specialization in manufacturing. It demonstrates how complex production processes are broken down into specialized roles, which is central to Smith's economic analysis.

3.0 KiB Raw Blame History