Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

barter_and_exchange

null

2026-02-23T04:37:58.719883

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes barter from monetary exchange and captures the essential elements of voluntary trade without money. It's precise enough to be operationally useful, though it could be slightly more concise.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly and extensively discussed in Book I, Chapter 2, where Smith uses barter examples (like the butcher-baker exchange) to illustrate the propensity to truck and barter as fundamental to human nature. The entity accurately reflects Smith's actual arguments about exchange preceding and enabling the division of labour.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the perfect domain placement for barter and exchange, as this represents the core mechanism by which economic actors interact. This is clearly an exchange phenomenon rather than production, distribution, or consumption.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	While barter operates primarily at the S1 level (basic operational exchanges between economic units), it also has S2 coordination aspects in how it enables specialization without central planning. However, it's somewhat abstract as a general mechanism rather than a specific system component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides crucial explanatory power by identifying the fundamental mechanism that enables the division of labour and economic specialization. Smith positions this as the foundational principle that makes complex economic systems possible, making it highly illuminating of structural economic relations.

Evaluation: Barter And Exchange

definition_precision — 4.0 / 5.0

The definition clearly distinguishes barter from monetary exchange and captures the essential elements of voluntary trade without money. It's precise enough to be operationally useful, though it could be slightly more concise.

source_grounding — 5.0 / 5.0

This concept is directly and extensively discussed in Book I, Chapter 2, where Smith uses barter examples (like the butcher-baker exchange) to illustrate the propensity to truck and barter as fundamental to human nature. The entity accurately reflects Smith's actual arguments about exchange preceding and enabling the division of labour.

domain_placement — 5.0 / 5.0

"Exchange" is the perfect domain placement for barter and exchange, as this represents the core mechanism by which economic actors interact. This is clearly an exchange phenomenon rather than production, distribution, or consumption.

vsm_relevance — 3.0 / 5.0

While barter operates primarily at the S1 level (basic operational exchanges between economic units), it also has S2 coordination aspects in how it enables specialization without central planning. However, it's somewhat abstract as a general mechanism rather than a specific system component.

explanatory_value — 5.0 / 5.0

This entity provides crucial explanatory power by identifying the fundamental mechanism that enables the division of labour and economic specialization. Smith positions this as the foundational principle that makes complex economic systems possible, making it highly illuminating of structural economic relations.

3.5 KiB Raw Blame History