feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: diamond_buckles_metaphor
evaluator: null
evaluated_at: '2026-02-23T05:05:55.566447'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures a specific mechanism - how commercial
wealth enables aristocrats to exchange dependency relationships for personal luxury
consumption. The diamond buckles serve as a concrete illustration of this broader
transformation rather than being vague or circular.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This is directly grounded in Smith's text from Book III, Chapter 4, where
he explicitly discusses how great proprietors exchanged their power for "trinkets
and baubles" and uses luxury items as examples of this transformation. The metaphor
accurately reflects Smith's actual argument about the unintended consequences
of commerce.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"Consumption" is appropriate as the entity focuses on how aristocratic
spending patterns changed, though it could also fit in a "Political Economy" or
"Social Structure" domain since it''s fundamentally about power relationships.
The consumption framing captures the immediate mechanism Smith describes.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This maps reasonably well to S4 (intelligence/environmental adaptation)
as it describes how aristocrats adapted their behavior to new commercial opportunities,
though the adaptation was ultimately self-destructive. It's not strongly VSM-oriented
but has some systemic relevance.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity illuminates a crucial causal mechanism in Smith's theory
- how commerce unintentionally undermines feudal power structures by changing
consumption incentives. It explains the structural transformation from feudalism
to commercial society through a specific behavioral change.
---
# Evaluation: Diamond Buckles Metaphor
## definition_precision — 4.0 / 5.0
The definition clearly captures a specific mechanism - how commercial wealth enables aristocrats to exchange dependency relationships for personal luxury consumption. The diamond buckles serve as a concrete illustration of this broader transformation rather than being vague or circular.
## source_grounding — 5.0 / 5.0
This is directly grounded in Smith's text from Book III, Chapter 4, where he explicitly discusses how great proprietors exchanged their power for "trinkets and baubles" and uses luxury items as examples of this transformation. The metaphor accurately reflects Smith's actual argument about the unintended consequences of commerce.
## domain_placement — 4.0 / 5.0
"Consumption" is appropriate as the entity focuses on how aristocratic spending patterns changed, though it could also fit in a "Political Economy" or "Social Structure" domain since it's fundamentally about power relationships. The consumption framing captures the immediate mechanism Smith describes.
## vsm_relevance — 3.0 / 5.0
This maps reasonably well to S4 (intelligence/environmental adaptation) as it describes how aristocrats adapted their behavior to new commercial opportunities, though the adaptation was ultimately self-destructive. It's not strongly VSM-oriented but has some systemic relevance.
## explanatory_value — 5.0 / 5.0
This entity illuminates a crucial causal mechanism in Smith's theory - how commerce unintentionally undermines feudal power structures by changing consumption incentives. It explains the structural transformation from feudalism to commercial society through a specific behavioral change.