Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

superfluity

null

2026-02-23T06:27:46.692317

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes superfluity as surplus production beyond personal consumption needs that enables exchange. It avoids circularity and captures a specific economic concept with clear boundaries.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses how division of labour creates surpluses that individuals can exchange. The entity accurately reflects Smith's actual argument about the foundations of commercial society.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Production" is an appropriate domain since superfluity emerges from the productive process and division of labour. However, it could also reasonably belong in an "Exchange" domain since its primary significance is enabling trade.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Superfluity maps reasonably well to S1 (primary operations) as it represents the output of productive activities, but it also relates to S4 (environmental adaptation) as surplus enables market exchange and adaptation. The mapping is not as clear-cut as more operational concepts.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the fundamental mechanism that enables the transition from subsistence to commercial society. It explains how division of labour creates the material basis for exchange and market development.

Evaluation: Superfluity

definition_precision — 4.0 / 5.0

The definition clearly distinguishes superfluity as surplus production beyond personal consumption needs that enables exchange. It avoids circularity and captures a specific economic concept with clear boundaries.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses how division of labour creates surpluses that individuals can exchange. The entity accurately reflects Smith's actual argument about the foundations of commercial society.

domain_placement — 4.0 / 5.0

"Production" is an appropriate domain since superfluity emerges from the productive process and division of labour. However, it could also reasonably belong in an "Exchange" domain since its primary significance is enabling trade.

vsm_relevance — 3.0 / 5.0

Superfluity maps reasonably well to S1 (primary operations) as it represents the output of productive activities, but it also relates to S4 (environmental adaptation) as surplus enables market exchange and adaptation. The mapping is not as clear-cut as more operational concepts.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the fundamental mechanism that enables the transition from subsistence to commercial society. It explains how division of labour creates the material basis for exchange and market development.

3.2 KiB Raw Blame History