Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

plate_household_silver

null

2026-02-23T06:06:17.985984

3.8

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes plate as household silverware made of precious metals, emphasizing its dual nature as both utility items and stored wealth. It avoids circularity and captures a specific concept distinct from mere currency or bullion.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion in Book IV, Chapter 1, where he explicitly addresses plate as a form of precious metal wealth and discusses its natural limitations based on wealthy families' demand for luxury items. The context accurately reflects Smith's analysis of plate within the mercantile system.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Consumption" is an appropriate domain since plate represents luxury consumption goods, though it could also fit in a wealth/capital category given its role as stored value. The consumption focus captures the primary economic function Smith emphasizes.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Plate as a physical commodity doesn't naturally map to specific VSM systems, as it's more of an economic object than an organizational function or process. It's largely VSM-neutral, representing a form of wealth storage rather than a systemic operation.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important mechanism in Smith's critique of mercantilism—how precious metals function beyond currency in household wealth accumulation. It helps explain the broader structural relations between luxury consumption, wealth storage, and the limitations of mercantilist thinking.

Evaluation: Plate Household Silver

definition_precision — 4.0 / 5.0

The definition clearly distinguishes plate as household silverware made of precious metals, emphasizing its dual nature as both utility items and stored wealth. It avoids circularity and captures a specific concept distinct from mere currency or bullion.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion in Book IV, Chapter 1, where he explicitly addresses plate as a form of precious metal wealth and discusses its natural limitations based on wealthy families' demand for luxury items. The context accurately reflects Smith's analysis of plate within the mercantile system.

domain_placement — 4.0 / 5.0

"Consumption" is an appropriate domain since plate represents luxury consumption goods, though it could also fit in a wealth/capital category given its role as stored value. The consumption focus captures the primary economic function Smith emphasizes.

vsm_relevance — 2.0 / 5.0

Plate as a physical commodity doesn't naturally map to specific VSM systems, as it's more of an economic object than an organizational function or process. It's largely VSM-neutral, representing a form of wealth storage rather than a systemic operation.

explanatory_value — 4.0 / 5.0

This entity illuminates an important mechanism in Smith's critique of mercantilism—how precious metals function beyond currency in household wealth accumulation. It helps explain the broader structural relations between luxury consumption, wealth storage, and the limitations of mercantilist thinking.

3.5 KiB Raw Blame History