Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

maritime_employment

null

2026-02-23T05:42:56.424158

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes maritime employment from other forms of work by focusing on its specific risk-reward structure and advancement opportunities. It avoids circularity and captures the distinct economic characteristics Smith identifies, though it could be slightly more precise about what constitutes "maritime employment."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis from Book I, Chapter 10, where he explicitly compares maritime and military employment to illustrate wage differentials based on risk and advancement prospects. The definition accurately reflects Smith's specific observations about sailors' wages, prize money, and career advancement.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Distribution" domain is correct, as Smith uses maritime employment to analyze how wages are distributed based on occupational characteristics like risk, hardship, and advancement opportunities. This fits perfectly within his broader theory of wage determination.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Maritime employment maps reasonably well to S1 (primary operations) as a specific type of economic activity, but it doesn't have strong natural connections to the regulatory or intelligence functions of other VSM systems. It's more of a concrete operational category than a systemic function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory value by illustrating Smith's mechanism for how wage differentials arise from occupational characteristics, serving as a concrete example of his broader theory of compensating wage differentials. It illuminates the structural relationship between risk, advancement prospects, and compensation.

Evaluation: Maritime Employment

definition_precision — 4.0 / 5.0

The definition clearly distinguishes maritime employment from other forms of work by focusing on its specific risk-reward structure and advancement opportunities. It avoids circularity and captures the distinct economic characteristics Smith identifies, though it could be slightly more precise about what constitutes "maritime employment."

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis from Book I, Chapter 10, where he explicitly compares maritime and military employment to illustrate wage differentials based on risk and advancement prospects. The definition accurately reflects Smith's specific observations about sailors' wages, prize money, and career advancement.

domain_placement — 5.0 / 5.0

Placement in the "Distribution" domain is correct, as Smith uses maritime employment to analyze how wages are distributed based on occupational characteristics like risk, hardship, and advancement opportunities. This fits perfectly within his broader theory of wage determination.

vsm_relevance — 3.0 / 5.0

Maritime employment maps reasonably well to S1 (primary operations) as a specific type of economic activity, but it doesn't have strong natural connections to the regulatory or intelligence functions of other VSM systems. It's more of a concrete operational category than a systemic function.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory value by illustrating Smith's mechanism for how wage differentials arise from occupational characteristics, serving as a concrete example of his broader theory of compensating wage differentials. It illuminates the structural relationship between risk, advancement prospects, and compensation.

3.8 KiB Raw Blame History