Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

dear_years

null

2026-02-23T05:04:53.322274

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies "dear years" as periods of scarcity and high prices with specific economic effects on labor market structure. It avoids circularity and captures a distinct temporal-economic phenomenon with measurable characteristics.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book I, Chapter 8, where he explicitly discusses how periods of high prices affect the proportion of independent workmen versus journeymen and the dynamics of employment. The entity accurately reflects Smith's actual observations about economic cycles.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate as this concept bridges labor economics, price theory, and cyclical economic analysis. It could potentially fit in a more specific labor or price domain, but its broad effects across multiple economic relationships justify the general theoretical placement.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily relating to S4 (environmental adaptation) as it describes how economic systems respond to external scarcity conditions. It also touches on S1 (operations) through its effects on labor market functioning, though it's more of an environmental condition than a system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating how external economic shocks (scarcity/high prices) systematically alter labor market structure and employment relationships. It reveals a causal mechanism linking price cycles to social-economic stratification rather than merely describing surface phenomena.

Evaluation: Dear Years

definition_precision — 4.0 / 5.0

The definition clearly identifies "dear years" as periods of scarcity and high prices with specific economic effects on labor market structure. It avoids circularity and captures a distinct temporal-economic phenomenon with measurable characteristics.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book I, Chapter 8, where he explicitly discusses how periods of high prices affect the proportion of independent workmen versus journeymen and the dynamics of employment. The entity accurately reflects Smith's actual observations about economic cycles.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate as this concept bridges labor economics, price theory, and cyclical economic analysis. It could potentially fit in a more specific labor or price domain, but its broad effects across multiple economic relationships justify the general theoretical placement.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily relating to S4 (environmental adaptation) as it describes how economic systems respond to external scarcity conditions. It also touches on S1 (operations) through its effects on labor market functioning, though it's more of an environmental condition than a system component.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating how external economic shocks (scarcity/high prices) systematically alter labor market structure and employment relationships. It reveals a causal mechanism linking price cycles to social-economic stratification rather than merely describing surface phenomena.

3.6 KiB Raw Blame History