Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

cheap_years

null

2026-02-23T04:42:38.976129

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies cheap years as periods of agricultural abundance with low prices and specifies their dual effects on labor composition (more independent workmen vs. journeymen/servants) and employment levels. The concept is distinct and non-circular, though it could be slightly more precise about the causal mechanisms.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analysis from Book I, Chapter 8, where he examines how periods of abundance affect wages, employment patterns, and the balance between different types of workers. The effects described align directly with Smith's observations about agricultural cycles and labor markets.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in "General Theory" is appropriate as this concept relates to fundamental economic mechanisms governing labor markets, wages, and employment patterns across the economy. It represents a structural economic phenomenon rather than a narrow sectoral issue.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily relating to S4 (intelligence/environmental adaptation) as it describes how economic systems respond to environmental changes in agricultural productivity. However, it's more of a cyclical phenomenon than a clear systemic function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory value by illuminating how agricultural abundance creates specific labor market dynamics and employment patterns. It reveals an important structural mechanism connecting agricultural cycles to broader economic organization and worker independence.

Evaluation: Cheap Years

definition_precision — 4.0 / 5.0

The definition clearly identifies cheap years as periods of agricultural abundance with low prices and specifies their dual effects on labor composition (more independent workmen vs. journeymen/servants) and employment levels. The concept is distinct and non-circular, though it could be slightly more precise about the causal mechanisms.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analysis from Book I, Chapter 8, where he examines how periods of abundance affect wages, employment patterns, and the balance between different types of workers. The effects described align directly with Smith's observations about agricultural cycles and labor markets.

domain_placement — 5.0 / 5.0

The placement in "General Theory" is appropriate as this concept relates to fundamental economic mechanisms governing labor markets, wages, and employment patterns across the economy. It represents a structural economic phenomenon rather than a narrow sectoral issue.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily relating to S4 (intelligence/environmental adaptation) as it describes how economic systems respond to environmental changes in agricultural productivity. However, it's more of a cyclical phenomenon than a clear systemic function.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory value by illuminating how agricultural abundance creates specific labor market dynamics and employment patterns. It reveals an important structural mechanism connecting agricultural cycles to broader economic organization and worker independence.

3.6 KiB Raw Blame History