Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

instruments_of_husbandry

null

2026-02-23T05:37:55.485830

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies specific agricultural tools and equipment, distinguishing them as fixed capital investments. It avoids circularity and captures a distinct category of productive assets in farming.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's discussion of agricultural capital and the farmer's stock in Book I, Chapter 6. Smith explicitly addresses how agricultural implements must be maintained from farm revenue.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate, as these instruments are fundamental inputs to the agricultural production process. This represents a core element of productive capital.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as the physical tools enabling agricultural production, and potentially to S3 regarding the maintenance and replacement decisions for these capital assets. It has clear operational relevance within the VSM framework.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural relationship in Smith's analysis—how agricultural pricing must account for capital maintenance costs. It reveals the mechanism by which fixed capital requirements influence market prices and resource allocation.

Evaluation: Instruments Of Husbandry

definition_precision — 4.0 / 5.0

The definition clearly identifies specific agricultural tools and equipment, distinguishing them as fixed capital investments. It avoids circularity and captures a distinct category of productive assets in farming.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's discussion of agricultural capital and the farmer's stock in Book I, Chapter 6. Smith explicitly addresses how agricultural implements must be maintained from farm revenue.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate, as these instruments are fundamental inputs to the agricultural production process. This represents a core element of productive capital.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as the physical tools enabling agricultural production, and potentially to S3 regarding the maintenance and replacement decisions for these capital assets. It has clear operational relevance within the VSM framework.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural relationship in Smith's analysis—how agricultural pricing must account for capital maintenance costs. It reveals the mechanism by which fixed capital requirements influence market prices and resource allocation.

3.0 KiB Raw Blame History