feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: barter_and_exchange
evaluator: null
evaluated_at: '2026-02-23T04:37:58.719883'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes barter from monetary exchange and
captures the essential elements of voluntary trade without money. It's precise
enough to be operationally useful, though it could be slightly more concise.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly and extensively discussed in Book I, Chapter
2, where Smith uses barter examples (like the butcher-baker exchange) to illustrate
the propensity to truck and barter as fundamental to human nature. The entity
accurately reflects Smith's actual arguments about exchange preceding and enabling
the division of labour.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Exchange" is the perfect domain placement for barter and exchange,
as this represents the core mechanism by which economic actors interact. This
is clearly an exchange phenomenon rather than production, distribution, or consumption.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: While barter operates primarily at the S1 level (basic operational exchanges
between economic units), it also has S2 coordination aspects in how it enables
specialization without central planning. However, it's somewhat abstract as a
general mechanism rather than a specific system component.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides crucial explanatory power by identifying the fundamental
mechanism that enables the division of labour and economic specialization. Smith
positions this as the foundational principle that makes complex economic systems
possible, making it highly illuminating of structural economic relations.
---
# Evaluation: Barter And Exchange
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes barter from monetary exchange and captures the essential elements of voluntary trade without money. It's precise enough to be operationally useful, though it could be slightly more concise.
## source_grounding — 5.0 / 5.0
This concept is directly and extensively discussed in Book I, Chapter 2, where Smith uses barter examples (like the butcher-baker exchange) to illustrate the propensity to truck and barter as fundamental to human nature. The entity accurately reflects Smith's actual arguments about exchange preceding and enabling the division of labour.
## domain_placement — 5.0 / 5.0
"Exchange" is the perfect domain placement for barter and exchange, as this represents the core mechanism by which economic actors interact. This is clearly an exchange phenomenon rather than production, distribution, or consumption.
## vsm_relevance — 3.0 / 5.0
While barter operates primarily at the S1 level (basic operational exchanges between economic units), it also has S2 coordination aspects in how it enables specialization without central planning. However, it's somewhat abstract as a general mechanism rather than a specific system component.
## explanatory_value — 5.0 / 5.0
This entity provides crucial explanatory power by identifying the fundamental mechanism that enables the division of labour and economic specialization. Smith positions this as the foundational principle that makes complex economic systems possible, making it highly illuminating of structural economic relations.