feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,61 @@
---
entity_slug: prudent_family_maxim
evaluator: null
evaluated_at: '2026-02-23T06:11:56.952197'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is clear and specific, capturing the principle of not
producing what costs more to make than to buy. It avoids circularity and identifies
a distinct economic concept about efficient resource allocation.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This is directly grounded in Smith's text from Book IV, Chapter 2, where
he explicitly uses the tailor/shoemaker example and states this household maxim
should guide national policy. The entity accurately reflects Smith's actual argument.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Exchange" is the correct domain placement since this maxim fundamentally
concerns the decision between making versus buying, which is at the heart of trade
and exchange relationships. It directly relates to comparative advantage and specialization.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This maps well to S4 (intelligence/environmental adaptation) as it represents
a decision-making principle for adapting to external market conditions, and to
S5 (policy) as it guides strategic choices about what activities to pursue internally
versus externally.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity illuminates a key mechanism underlying Smith's argument for
free trade and specialization, showing how individual rational behavior scales
to national economic policy. It explains the structural logic connecting household
and national economic decisions.
---
# Evaluation: Prudent Family Maxim
## definition_precision — 4.0 / 5.0
The definition is clear and specific, capturing the principle of not producing what costs more to make than to buy. It avoids circularity and identifies a distinct economic concept about efficient resource allocation.
## source_grounding — 5.0 / 5.0
This is directly grounded in Smith's text from Book IV, Chapter 2, where he explicitly uses the tailor/shoemaker example and states this household maxim should guide national policy. The entity accurately reflects Smith's actual argument.
## domain_placement — 5.0 / 5.0
"Exchange" is the correct domain placement since this maxim fundamentally concerns the decision between making versus buying, which is at the heart of trade and exchange relationships. It directly relates to comparative advantage and specialization.
## vsm_relevance — 4.0 / 5.0
This maps well to S4 (intelligence/environmental adaptation) as it represents a decision-making principle for adapting to external market conditions, and to S5 (policy) as it guides strategic choices about what activities to pursue internally versus externally.
## explanatory_value — 4.0 / 5.0
This entity illuminates a key mechanism underlying Smith's argument for free trade and specialization, showing how individual rational behavior scales to national economic policy. It explains the structural logic connecting household and national economic decisions.