Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

inland_trade

null

2026-02-23T05:37:38.947367

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes inland trade from foreign trade and provides a specific characteristic (lower uncertainty, therefore lower profit rates). It captures a distinct concept rather than being vague, though it could be slightly more precise about what constitutes "within the boundaries of a single country."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analysis from Book I, Chapter 10, where he explicitly discusses how profits vary with certainty/uncertainty of returns and compares inland versus foreign trade. The characterization accurately reflects Smith's observations about risk-adjusted returns.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for inland trade, as this concept fundamentally concerns commercial exchange mechanisms and their characteristics. It fits naturally within Smith's broader analysis of different forms of commerce and capital employment.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Inland trade has some relevance to S1 (as a primary operational activity) and potentially S4 (as it relates to environmental adaptation through domestic versus international focus), but it doesn't map strongly to any particular VSM system. It's more of a descriptive category than a systemic function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory value by illuminating the mechanism behind profit differentials based on risk and uncertainty. It helps explain structural relations in Smith's theory of how different employments of capital generate varying returns, contributing to understanding of market dynamics.

Evaluation: Inland Trade

definition_precision — 4.0 / 5.0

The definition clearly distinguishes inland trade from foreign trade and provides a specific characteristic (lower uncertainty, therefore lower profit rates). It captures a distinct concept rather than being vague, though it could be slightly more precise about what constitutes "within the boundaries of a single country."

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analysis from Book I, Chapter 10, where he explicitly discusses how profits vary with certainty/uncertainty of returns and compares inland versus foreign trade. The characterization accurately reflects Smith's observations about risk-adjusted returns.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for inland trade, as this concept fundamentally concerns commercial exchange mechanisms and their characteristics. It fits naturally within Smith's broader analysis of different forms of commerce and capital employment.

vsm_relevance — 3.0 / 5.0

Inland trade has some relevance to S1 (as a primary operational activity) and potentially S4 (as it relates to environmental adaptation through domestic versus international focus), but it doesn't map strongly to any particular VSM system. It's more of a descriptive category than a systemic function.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory value by illuminating the mechanism behind profit differentials based on risk and uncertainty. It helps explain structural relations in Smith's theory of how different employments of capital generate varying returns, contributing to understanding of market dynamics.

3.6 KiB Raw Blame History