Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

diamond_buckles_metaphor

null

2026-02-23T05:05:55.566447

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures a specific mechanism - how commercial wealth enables aristocrats to exchange dependency relationships for personal luxury consumption. The diamond buckles serve as a concrete illustration of this broader transformation rather than being vague or circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This is directly grounded in Smith's text from Book III, Chapter 4, where he explicitly discusses how great proprietors exchanged their power for "trinkets and baubles" and uses luxury items as examples of this transformation. The metaphor accurately reflects Smith's actual argument about the unintended consequences of commerce.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Consumption" is appropriate as the entity focuses on how aristocratic spending patterns changed, though it could also fit in a "Political Economy" or "Social Structure" domain since it's fundamentally about power relationships. The consumption framing captures the immediate mechanism Smith describes.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This maps reasonably well to S4 (intelligence/environmental adaptation) as it describes how aristocrats adapted their behavior to new commercial opportunities, though the adaptation was ultimately self-destructive. It's not strongly VSM-oriented but has some systemic relevance.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial causal mechanism in Smith's theory - how commerce unintentionally undermines feudal power structures by changing consumption incentives. It explains the structural transformation from feudalism to commercial society through a specific behavioral change.

Evaluation: Diamond Buckles Metaphor

definition_precision — 4.0 / 5.0

The definition clearly captures a specific mechanism - how commercial wealth enables aristocrats to exchange dependency relationships for personal luxury consumption. The diamond buckles serve as a concrete illustration of this broader transformation rather than being vague or circular.

source_grounding — 5.0 / 5.0

This is directly grounded in Smith's text from Book III, Chapter 4, where he explicitly discusses how great proprietors exchanged their power for "trinkets and baubles" and uses luxury items as examples of this transformation. The metaphor accurately reflects Smith's actual argument about the unintended consequences of commerce.

domain_placement — 4.0 / 5.0

"Consumption" is appropriate as the entity focuses on how aristocratic spending patterns changed, though it could also fit in a "Political Economy" or "Social Structure" domain since it's fundamentally about power relationships. The consumption framing captures the immediate mechanism Smith describes.

vsm_relevance — 3.0 / 5.0

This maps reasonably well to S4 (intelligence/environmental adaptation) as it describes how aristocrats adapted their behavior to new commercial opportunities, though the adaptation was ultimately self-destructive. It's not strongly VSM-oriented but has some systemic relevance.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial causal mechanism in Smith's theory - how commerce unintentionally undermines feudal power structures by changing consumption incentives. It explains the structural transformation from feudalism to commercial society through a specific behavioral change.

3.7 KiB Raw Blame History