Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

trade_encouragement

null

2026-02-23T06:33:15.863017

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures the concept of mutual benefits arising from specialized exchange between regions. It avoids circularity by explaining the mechanism (comparative advantage leading to reciprocal market creation) rather than just restating "encouragement."

name	value	max_value	rationale
source_grounding	5.0	5.0	The entity is directly grounded in Smith's specific example of London and Edinburgh's commerce, with the exact quote provided showing how markets "give a good deal of encouragement to each other's industry." This is clearly stated in the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the correct domain placement, as this concept fundamentally concerns how market transactions create reciprocal benefits between trading partners. The entity sits squarely within exchange theory rather than production, distribution, or consumption.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S1 (as operational exchange activity) or S4 (as environmental adaptation through market intelligence). However, it's somewhat abstract and doesn't clearly belong to a single VSM system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism in Smith's theory—how specialization and trade create self-reinforcing cycles of industrial development through mutual market provision. This goes beyond surface description to explain a structural economic relationship.

Evaluation: Trade Encouragement

definition_precision — 4.0 / 5.0

The definition clearly captures the concept of mutual benefits arising from specialized exchange between regions. It avoids circularity by explaining the mechanism (comparative advantage leading to reciprocal market creation) rather than just restating "encouragement."

source_grounding — 5.0 / 5.0

The entity is directly grounded in Smith's specific example of London and Edinburgh's commerce, with the exact quote provided showing how markets "give a good deal of encouragement to each other's industry." This is clearly stated in the source text.

domain_placement — 5.0 / 5.0

"Exchange" is the correct domain placement, as this concept fundamentally concerns how market transactions create reciprocal benefits between trading partners. The entity sits squarely within exchange theory rather than production, distribution, or consumption.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S1 (as operational exchange activity) or S4 (as environmental adaptation through market intelligence). However, it's somewhat abstract and doesn't clearly belong to a single VSM system.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism in Smith's theory—how specialization and trade create self-reinforcing cycles of industrial development through mutual market provision. This goes beyond surface description to explain a structural economic relationship.

3.3 KiB Raw Blame History