Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

conversion_price

null

2026-02-23T05:02:43.485325

3.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly specifying what conversion price means (agricultural produce to money conversion rate), the context (Scottish tenancy agreements), and the key characteristic (set below market rates). It captures a distinct economic mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	4.0	5.0	This appears well-grounded in Smith's actual discussion of Scottish agricultural practices in Book I, Chapter 11, where he examines rent structures and tenant-landlord relationships. The specificity of the Scottish context and agricultural focus aligns with Smith's detailed treatment of these topics.

name	value	max_value	rationale
domain_placement	3.0	5.0	While "Distribution" is reasonable given this relates to how agricultural rents and payments are distributed between landlords and tenants, it could arguably fit better in a domain focused on agricultural economics or pricing mechanisms. The placement is defensible but not optimal.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity has limited VSM relevance as it describes a specific historical pricing mechanism rather than a systemic function. It might loosely relate to S2 (coordination) in how it coordinates landlord-tenant relationships, but the connection is weak and the concept is quite VSM-neutral.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides good explanatory value by illuminating a specific mechanism in agricultural economics that shows how pricing structures can protect tenants while maintaining landlord-tenant relationships. It reveals an important structural relation in historical agricultural markets.

Evaluation: Conversion Price

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly specifying what conversion price means (agricultural produce to money conversion rate), the context (Scottish tenancy agreements), and the key characteristic (set below market rates). It captures a distinct economic mechanism rather than a vague concept.

source_grounding — 4.0 / 5.0

This appears well-grounded in Smith's actual discussion of Scottish agricultural practices in Book I, Chapter 11, where he examines rent structures and tenant-landlord relationships. The specificity of the Scottish context and agricultural focus aligns with Smith's detailed treatment of these topics.

domain_placement — 3.0 / 5.0

While "Distribution" is reasonable given this relates to how agricultural rents and payments are distributed between landlords and tenants, it could arguably fit better in a domain focused on agricultural economics or pricing mechanisms. The placement is defensible but not optimal.

vsm_relevance — 2.0 / 5.0

This entity has limited VSM relevance as it describes a specific historical pricing mechanism rather than a systemic function. It might loosely relate to S2 (coordination) in how it coordinates landlord-tenant relationships, but the connection is weak and the concept is quite VSM-neutral.

explanatory_value — 4.0 / 5.0

This entity provides good explanatory value by illuminating a specific mechanism in agricultural economics that shows how pricing structures can protect tenants while maintaining landlord-tenant relationships. It reveals an important structural relation in historical agricultural markets.

3.6 KiB Raw Blame History