Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

menial_servants

null

2026-02-23T05:50:24.868353

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly identifying menial servants as domestic workers employed by those with surplus revenue, and establishing the causal relationship between increased surplus revenue and increased employment of such servants. The definition avoids circularity and captures a distinct economic phenomenon.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text from Book I, Chapter 8, where he explicitly discusses how landlords and others with unearned income employ domestic servants when their revenue exceeds family maintenance needs. The concept directly reflects Smith's analysis of consumption patterns among the rentier class.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in the "Consumption" domain is entirely appropriate, as menial servants represent a form of consumption expenditure by those with surplus revenue rather than productive investment. This aligns perfectly with Smith's distinction between productive and unproductive labor.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity has limited VSM relevance as it describes a consumption pattern rather than a systemic function. While it might tangentially relate to S1 (as economic activity) or S4 (as environmental response to surplus), it doesn't naturally map to any specific VSM system's core functions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides good explanatory value by illustrating Smith's theory of how unearned income creates demand for unproductive labor, demonstrating the mechanism by which surplus revenue translates into employment patterns. It reveals an important structural relationship between income sources and labor allocation in Smith's economic framework.

Evaluation: Menial Servants

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly identifying menial servants as domestic workers employed by those with surplus revenue, and establishing the causal relationship between increased surplus revenue and increased employment of such servants. The definition avoids circularity and captures a distinct economic phenomenon.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text from Book I, Chapter 8, where he explicitly discusses how landlords and others with unearned income employ domestic servants when their revenue exceeds family maintenance needs. The concept directly reflects Smith's analysis of consumption patterns among the rentier class.

domain_placement — 5.0 / 5.0

The placement in the "Consumption" domain is entirely appropriate, as menial servants represent a form of consumption expenditure by those with surplus revenue rather than productive investment. This aligns perfectly with Smith's distinction between productive and unproductive labor.

vsm_relevance — 2.0 / 5.0

This entity has limited VSM relevance as it describes a consumption pattern rather than a systemic function. While it might tangentially relate to S1 (as economic activity) or S4 (as environmental response to surplus), it doesn't naturally map to any specific VSM system's core functions.

explanatory_value — 4.0 / 5.0

The entity provides good explanatory value by illustrating Smith's theory of how unearned income creates demand for unproductive labor, demonstrating the mechanism by which surplus revenue translates into employment patterns. It reveals an important structural relationship between income sources and labor allocation in Smith's economic framework.

3.8 KiB Raw Blame History