Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_development_sequence_inversion

null

2026-02-23T04:57:42.464138

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures a specific historical pattern - the reversal of expected development sequence where commerce/manufacturing preceded agriculture in Europe versus the "natural" order seen in colonies. The concept is distinct and well-bounded, though it could be slightly more precise about what constitutes "natural order."

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book III, Chapter 4, where he explicitly discusses how European development inverted the natural progression and compares this unfavorably to colonial development patterns. The entity accurately reflects Smith's actual argument about historical development sequences.

name	value	max_value	rationale
domain_placement	3.0	5.0	While no domain is specified, this entity spans multiple economic domains - it involves agricultural economics, commercial development, and historical economic analysis. It would benefit from clearer domain categorization, possibly as "Economic Development" or "Historical Economics."

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to environmental constraints and historical circumstances. It also touches on S1 (primary operations) in terms of the sequencing of fundamental economic activities.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by identifying a structural mechanism that explains why European agricultural development was "slow and uncertain" compared to colonies. It illuminates a fundamental pattern in economic development rather than merely describing surface phenomena.

Evaluation: Commercial Development Sequence Inversion

definition_precision — 4.0 / 5.0

The definition clearly captures a specific historical pattern - the reversal of expected development sequence where commerce/manufacturing preceded agriculture in Europe versus the "natural" order seen in colonies. The concept is distinct and well-bounded, though it could be slightly more precise about what constitutes "natural order."

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book III, Chapter 4, where he explicitly discusses how European development inverted the natural progression and compares this unfavorably to colonial development patterns. The entity accurately reflects Smith's actual argument about historical development sequences.

domain_placement — 3.0 / 5.0

While no domain is specified, this entity spans multiple economic domains - it involves agricultural economics, commercial development, and historical economic analysis. It would benefit from clearer domain categorization, possibly as "Economic Development" or "Historical Economics."

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to environmental constraints and historical circumstances. It also touches on S1 (primary operations) in terms of the sequencing of fundamental economic activities.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by identifying a structural mechanism that explains why European agricultural development was "slow and uncertain" compared to colonies. It illuminates a fundamental pattern in economic development rather than merely describing surface phenomena.

3.8 KiB Raw Blame History