Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

distant_country_subsistence

null

2026-02-23T05:06:31.053790

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes this concept from typical local town-country relationships by specifying the key differentiator - distance of subsistence sources. It captures a distinct economic arrangement without being circular, though it could be slightly more precise about what constitutes "very distant."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion in Book III, Chapter 1, where he explicitly addresses how towns can obtain subsistence from distant countries as an exception to the general pattern. The concept directly reflects Smith's acknowledgment of variations in the typical development model.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this concept fundamentally concerns trade relationships and the flow of goods between geographically separated economic units. It's centrally about exchange mechanisms rather than production or distribution per se.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents how economic systems adapt to environmental constraints through long-distance trade relationships. It also has relevance to S1 (operations) in terms of how primary subsistence needs are met through alternative channels.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating how international trade can alter natural development patterns while maintaining fundamental dependencies. It helps explain variations in economic development across different historical contexts and geographical situations.

Evaluation: Distant Country Subsistence

definition_precision — 4.0 / 5.0

The definition clearly distinguishes this concept from typical local town-country relationships by specifying the key differentiator - distance of subsistence sources. It captures a distinct economic arrangement without being circular, though it could be slightly more precise about what constitutes "very distant."

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion in Book III, Chapter 1, where he explicitly addresses how towns can obtain subsistence from distant countries as an exception to the general pattern. The concept directly reflects Smith's acknowledgment of variations in the typical development model.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this concept fundamentally concerns trade relationships and the flow of goods between geographically separated economic units. It's centrally about exchange mechanisms rather than production or distribution per se.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents how economic systems adapt to environmental constraints through long-distance trade relationships. It also has relevance to S1 (operations) in terms of how primary subsistence needs are met through alternative channels.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating how international trade can alter natural development patterns while maintaining fundamental dependencies. It helps explain variations in economic development across different historical contexts and geographical situations.

3.6 KiB Raw Blame History