feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: plate_household_silver
evaluator: null
evaluated_at: '2026-02-23T06:06:17.985984'
overall_score: 3.8
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes plate as household silverware made
of precious metals, emphasizing its dual nature as both utility items and stored
wealth. It avoids circularity and captures a specific concept distinct from mere
currency or bullion.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual discussion in Book IV,
Chapter 1, where he explicitly addresses plate as a form of precious metal wealth
and discusses its natural limitations based on wealthy families' demand for luxury
items. The context accurately reflects Smith's analysis of plate within the mercantile
system.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"Consumption" is an appropriate domain since plate represents luxury
consumption goods, though it could also fit in a wealth/capital category given
its role as stored value. The consumption focus captures the primary economic
function Smith emphasizes.'
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: Plate as a physical commodity doesn't naturally map to specific VSM systems,
as it's more of an economic object than an organizational function or process.
It's largely VSM-neutral, representing a form of wealth storage rather than a
systemic operation.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: "This entity illuminates an important mechanism in Smith's critique of\
\ mercantilism\u2014how precious metals function beyond currency in household\
\ wealth accumulation. It helps explain the broader structural relations between\
\ luxury consumption, wealth storage, and the limitations of mercantilist thinking."
---
# Evaluation: Plate Household Silver
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes plate as household silverware made of precious metals, emphasizing its dual nature as both utility items and stored wealth. It avoids circularity and captures a specific concept distinct from mere currency or bullion.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual discussion in Book IV, Chapter 1, where he explicitly addresses plate as a form of precious metal wealth and discusses its natural limitations based on wealthy families' demand for luxury items. The context accurately reflects Smith's analysis of plate within the mercantile system.
## domain_placement — 4.0 / 5.0
"Consumption" is an appropriate domain since plate represents luxury consumption goods, though it could also fit in a wealth/capital category given its role as stored value. The consumption focus captures the primary economic function Smith emphasizes.
## vsm_relevance — 2.0 / 5.0
Plate as a physical commodity doesn't naturally map to specific VSM systems, as it's more of an economic object than an organizational function or process. It's largely VSM-neutral, representing a form of wealth storage rather than a systemic operation.
## explanatory_value — 4.0 / 5.0
This entity illuminates an important mechanism in Smith's critique of mercantilism—how precious metals function beyond currency in household wealth accumulation. It helps explain the broader structural relations between luxury consumption, wealth storage, and the limitations of mercantilist thinking.