Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

capital_of_the_farmer

null

2026-02-23T04:41:02.632610

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying distinct components (seeds, equipment, livestock, labor funds) rather than using vague terms. It captures a well-bounded economic concept of agricultural working capital.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does discuss farmer capital in the context of bounties and agricultural investment in Book IV, Chapter 5. The entity accurately reflects his analysis of how farmer capital must be compensated for agricultural trade to be beneficial.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain assignment since this concerns the capital inputs necessary for agricultural production processes. This is fundamentally about the productive capacity of the economy.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S1 (primary operations) as it represents the essential resources needed for agricultural production operations. It could also relate to S3 regarding resource allocation and management within the agricultural sector.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism in Smith's analysis - how capital investment requirements affect the true economics of agricultural bounties and trade policies. It helps explain the structural relationship between government incentives and private investment.

Evaluation: Capital Of The Farmer

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying distinct components (seeds, equipment, livestock, labor funds) rather than using vague terms. It captures a well-bounded economic concept of agricultural working capital.

source_grounding — 4.0 / 5.0

Smith does discuss farmer capital in the context of bounties and agricultural investment in Book IV, Chapter 5. The entity accurately reflects his analysis of how farmer capital must be compensated for agricultural trade to be beneficial.

domain_placement — 5.0 / 5.0

"Production" is the correct domain assignment since this concerns the capital inputs necessary for agricultural production processes. This is fundamentally about the productive capacity of the economy.

vsm_relevance — 4.0 / 5.0

This maps well to S1 (primary operations) as it represents the essential resources needed for agricultural production operations. It could also relate to S3 regarding resource allocation and management within the agricultural sector.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism in Smith's analysis - how capital investment requirements affect the true economics of agricultural bounties and trade policies. It helps explain the structural relationship between government incentives and private investment.

3.0 KiB Raw Blame History