Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

home_trade

null

2026-02-23T05:35:02.311952

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes home trade from foreign trade by specifying it occurs within a single country's borders, and includes helpful subcategories (inland and coasting trade). The concept is distinct and well-bounded, though it could be slightly more precise about what constitutes "a country" in Smith's context.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book II, Chapter 5 where Smith explicitly discusses home trade and its advantages over foreign trade. The context accurately reflects Smith's argument that home trade "replaces two distinct capitals employed in domestic industry" and provides the greatest encouragement to productive labor.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for home trade, as it fundamentally concerns the mechanisms and patterns of exchanging goods within an economy. This is clearly a concept about how exchange systems operate rather than production, consumption, or regulation.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Home trade has some VSM relevance as it relates to S1 (primary operations of economic activity) and potentially S2 (coordination between different regional markets). However, it's more of a descriptive category of economic activity rather than a clear cybernetic function or control mechanism.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illuminating Smith's theory of why domestic trade is superior to foreign trade in terms of capital replacement and labor encouragement. It reveals an important structural relationship in Smith's economic theory about the relative benefits of different forms of commerce.

Evaluation: Home Trade

definition_precision — 4.0 / 5.0

The definition clearly distinguishes home trade from foreign trade by specifying it occurs within a single country's borders, and includes helpful subcategories (inland and coasting trade). The concept is distinct and well-bounded, though it could be slightly more precise about what constitutes "a country" in Smith's context.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book II, Chapter 5 where Smith explicitly discusses home trade and its advantages over foreign trade. The context accurately reflects Smith's argument that home trade "replaces two distinct capitals employed in domestic industry" and provides the greatest encouragement to productive labor.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for home trade, as it fundamentally concerns the mechanisms and patterns of exchanging goods within an economy. This is clearly a concept about how exchange systems operate rather than production, consumption, or regulation.

vsm_relevance — 3.0 / 5.0

Home trade has some VSM relevance as it relates to S1 (primary operations of economic activity) and potentially S2 (coordination between different regional markets). However, it's more of a descriptive category of economic activity rather than a clear cybernetic function or control mechanism.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illuminating Smith's theory of why domestic trade is superior to foreign trade in terms of capital replacement and labor encouragement. It reveals an important structural relationship in Smith's economic theory about the relative benefits of different forms of commerce.

3.7 KiB Raw Blame History