Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_opportunity_cost

null

2026-02-23T05:11:13.704041

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures the specific concept of foregone benefits from limited market access and specialization constraints. While it could be slightly more precise about the causal mechanism, it avoids circularity and distinguishes this from general opportunity cost by focusing on market extent limitations.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 3, with specific examples cited (the highland nailer, farmers as butchers/bakers/brewers). The concept emerges naturally from Smith's discussion of how market size constraints force suboptimal resource allocation.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical principle about market functioning and specialization constraints. It's not sector-specific but rather a core mechanism in Smith's economic framework.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily relating to S4 (intelligence/adaptation) as it concerns environmental constraints limiting system optimization, and S1 (operations) regarding production efficiency. However, it's somewhat abstract and doesn't map cleanly to a single VSM system.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural relationship between market extent and economic efficiency. It reveals a key mechanism in Smith's theory about how geographic and institutional constraints create systematic inefficiencies through forced self-sufficiency.

Evaluation: Economic Opportunity Cost

definition_precision — 4.0 / 5.0

The definition clearly captures the specific concept of foregone benefits from limited market access and specialization constraints. While it could be slightly more precise about the causal mechanism, it avoids circularity and distinguishes this from general opportunity cost by focusing on market extent limitations.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 3, with specific examples cited (the highland nailer, farmers as butchers/bakers/brewers). The concept emerges naturally from Smith's discussion of how market size constraints force suboptimal resource allocation.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical principle about market functioning and specialization constraints. It's not sector-specific but rather a core mechanism in Smith's economic framework.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily relating to S4 (intelligence/adaptation) as it concerns environmental constraints limiting system optimization, and S1 (operations) regarding production efficiency. However, it's somewhat abstract and doesn't map cleanly to a single VSM system.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural relationship between market extent and economic efficiency. It reveals a key mechanism in Smith's theory about how geographic and institutional constraints create systematic inefficiencies through forced self-sufficiency.

3.6 KiB Raw Blame History