Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

market_extent

null

2026-02-23T05:45:35.672349

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes market extent as the geographical and economic reach that constrains division of labor, avoiding circularity. It could be slightly more precise about what constitutes "geographical and economic reach" but captures a distinct, measurable concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit argument in Book I, Chapter 3, where he establishes the fundamental principle that "the division of labour is limited by the extent of the market." The concept is central to Smith's theoretical framework rather than an interpretive overlay.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Exchange" domain is precisely correct, as market extent fundamentally determines the scope and possibility of exchange relationships. This is the natural conceptual home for understanding how markets enable or constrain economic activity.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Market extent maps well to S4 (intelligence/environmental adaptation) as it represents the environmental constraints and opportunities that shape organizational structure and specialization. It also has relevance to S1 (operations) in determining what operational configurations are viable.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a fundamental structural mechanism in Smith's economics—how the size of markets creates feedback loops that determine the degree of specialization possible. It explains why certain economic structures emerge under different market conditions rather than merely describing surface phenomena.

Evaluation: Market Extent

definition_precision — 4.0 / 5.0

The definition clearly distinguishes market extent as the geographical and economic reach that constrains division of labor, avoiding circularity. It could be slightly more precise about what constitutes "geographical and economic reach" but captures a distinct, measurable concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit argument in Book I, Chapter 3, where he establishes the fundamental principle that "the division of labour is limited by the extent of the market." The concept is central to Smith's theoretical framework rather than an interpretive overlay.

domain_placement — 5.0 / 5.0

Placement in the "Exchange" domain is precisely correct, as market extent fundamentally determines the scope and possibility of exchange relationships. This is the natural conceptual home for understanding how markets enable or constrain economic activity.

vsm_relevance — 4.0 / 5.0

Market extent maps well to S4 (intelligence/environmental adaptation) as it represents the environmental constraints and opportunities that shape organizational structure and specialization. It also has relevance to S1 (operations) in determining what operational configurations are viable.

explanatory_value — 5.0 / 5.0

This entity illuminates a fundamental structural mechanism in Smith's economics—how the size of markets creates feedback loops that determine the degree of specialization possible. It explains why certain economic structures emerge under different market conditions rather than merely describing surface phenomena.

3.6 KiB Raw Blame History