Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

collier

null

2026-02-23T04:44:14.447539

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying a collier as a coal miner and precisely explaining Smith's use of this example to illustrate wage premiums for dangerous work. The definition avoids circularity and captures a distinct occupational category with specific economic characteristics.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses coal miners and their wages relative to common labor. The specific details about wages being "double or triple" those of common labour accurately reflect Smith's analysis of compensating differentials.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in "Distribution" is correct, as this example directly relates to how wages are distributed based on the nature of work - a core concern of distribution theory. Smith uses colliers to explain the mechanisms behind wage differentials, which is fundamentally about how economic rewards are allocated.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity represents a specific occupational example rather than a systemic function or mechanism that would map naturally to VSM systems. While it illustrates economic principles, it's more of an empirical case study than a structural component of an economic system's viability.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides strong explanatory value by illustrating the concrete mechanism of compensating wage differentials - how market forces adjust compensation based on job characteristics. It demonstrates a fundamental principle of labor economics through a specific, relatable example that illuminates broader structural relations in wage determination.

Evaluation: Collier

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying a collier as a coal miner and precisely explaining Smith's use of this example to illustrate wage premiums for dangerous work. The definition avoids circularity and captures a distinct occupational category with specific economic characteristics.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses coal miners and their wages relative to common labor. The specific details about wages being "double or triple" those of common labour accurately reflect Smith's analysis of compensating differentials.

domain_placement — 5.0 / 5.0

The placement in "Distribution" is correct, as this example directly relates to how wages are distributed based on the nature of work - a core concern of distribution theory. Smith uses colliers to explain the mechanisms behind wage differentials, which is fundamentally about how economic rewards are allocated.

vsm_relevance — 2.0 / 5.0

This entity represents a specific occupational example rather than a systemic function or mechanism that would map naturally to VSM systems. While it illustrates economic principles, it's more of an empirical case study than a structural component of an economic system's viability.

explanatory_value — 4.0 / 5.0

The entity provides strong explanatory value by illustrating the concrete mechanism of compensating wage differentials - how market forces adjust compensation based on job characteristics. It demonstrates a fundamental principle of labor economics through a specific, relatable example that illuminates broader structural relations in wage determination.

3.7 KiB Raw Blame History