Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

farmer_s_capital

null

2026-02-23T05:27:41.234126

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes between fixed capital (instruments and breeding cattle) and circulating capital (wages and maintenance) in agriculture, providing concrete examples for each category. While precise, it could benefit from slightly more detail about the functional differences between these capital types.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed discussion of agricultural capital in Book II, Chapter 1, where he explicitly analyzes the farmer's stock and its division into fixed and circulating components. The examples of breeding cattle, instruments of husbandry, and labor costs are all drawn from Smith's original text.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate, as this entity deals with the capital structure underlying agricultural production processes. Agriculture represents one of Smith's primary examples of productive economic activity.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it describes the capital structure that enables the fundamental productive operations of agriculture. It also has some relevance to S3 (internal regulation) in terms of how capital allocation decisions are made within the farming operation.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine insight into how capital functions in agricultural production, illustrating the important distinction between fixed and circulating capital through a concrete sectoral example. It helps explain the structural mechanics of how agricultural profit is generated through both capital appreciation and sales.

Evaluation: Farmer S Capital

definition_precision — 4.0 / 5.0

The definition clearly distinguishes between fixed capital (instruments and breeding cattle) and circulating capital (wages and maintenance) in agriculture, providing concrete examples for each category. While precise, it could benefit from slightly more detail about the functional differences between these capital types.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed discussion of agricultural capital in Book II, Chapter 1, where he explicitly analyzes the farmer's stock and its division into fixed and circulating components. The examples of breeding cattle, instruments of husbandry, and labor costs are all drawn from Smith's original text.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate, as this entity deals with the capital structure underlying agricultural production processes. Agriculture represents one of Smith's primary examples of productive economic activity.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it describes the capital structure that enables the fundamental productive operations of agriculture. It also has some relevance to S3 (internal regulation) in terms of how capital allocation decisions are made within the farming operation.

explanatory_value — 4.0 / 5.0

The entity provides genuine insight into how capital functions in agricultural production, illustrating the important distinction between fixed and circulating capital through a concrete sectoral example. It helps explain the structural mechanics of how agricultural profit is generated through both capital appreciation and sales.

3.7 KiB Raw Blame History