Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

farm_rent

null

2026-02-23T05:27:24.449251

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes farm rent as a fixed annual payment for revenue collection rights, contrasting it with percentage-based arrangements. It provides specific context about medieval economic systems and town revenue collection, making the concept distinct and well-bounded.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion of towns being granted revenue collection rights "in farm" from Book III, Chapter 3. The concept accurately reflects Smith's analysis of how this practice transformed urban economic development and governance.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate since farm rents represent a regulatory mechanism for organizing revenue collection and governance structures. This concept fundamentally concerns how economic activities are regulated and administered rather than production or exchange.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Farm rent maps well to S3 (internal regulation/audit) as it represents a control mechanism for revenue collection and governance oversight. It also has elements of S2 (coordination) in how it structures relationships between different levels of authority in economic systems.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial mechanism in Smith's analysis of how urban economic development was structured and incentivized through specific institutional arrangements. It explains how fixed payment systems created different incentive structures than variable revenue sharing, driving urban growth and self-governance.

Evaluation: Farm Rent

definition_precision — 4.0 / 5.0

The definition clearly distinguishes farm rent as a fixed annual payment for revenue collection rights, contrasting it with percentage-based arrangements. It provides specific context about medieval economic systems and town revenue collection, making the concept distinct and well-bounded.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion of towns being granted revenue collection rights "in farm" from Book III, Chapter 3. The concept accurately reflects Smith's analysis of how this practice transformed urban economic development and governance.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate since farm rents represent a regulatory mechanism for organizing revenue collection and governance structures. This concept fundamentally concerns how economic activities are regulated and administered rather than production or exchange.

vsm_relevance — 4.0 / 5.0

Farm rent maps well to S3 (internal regulation/audit) as it represents a control mechanism for revenue collection and governance oversight. It also has elements of S2 (coordination) in how it structures relationships between different levels of authority in economic systems.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial mechanism in Smith's analysis of how urban economic development was structured and incentivized through specific institutional arrangements. It explains how fixed payment systems created different incentive structures than variable revenue sharing, driving urban growth and self-governance.

3.5 KiB Raw Blame History