Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

purveyance

null

2026-02-23T06:14:48.403741

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a distinct feudal practice with clear operational characteristics (requisitioning at regulated prices during specific circumstances). It avoids circularity and distinguishes purveyance from general taxation through its specific mechanism and context.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book III, Chapter 2, where he explicitly discusses purveyance as one of the arbitrary services imposed on the yeomanry and notes its abolition as part of legal reforms in Great Britain.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate, as purveyance represents a specific regulatory mechanism of feudal governance that constrained economic activity through mandatory provision of goods and services.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Purveyance maps reasonably well to S3 (internal regulation) as a control mechanism within the feudal system, though it also has S1 operational aspects in terms of resource extraction. However, it's primarily a historical regulatory practice rather than a core VSM concept.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illustrating a specific mechanism through which feudal systems extracted resources and burdened economic actors, helping explain the structural constraints on economic development that Smith analyzes.

Evaluation: Purveyance

definition_precision — 4.0 / 5.0

The definition is precise and captures a distinct feudal practice with clear operational characteristics (requisitioning at regulated prices during specific circumstances). It avoids circularity and distinguishes purveyance from general taxation through its specific mechanism and context.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book III, Chapter 2, where he explicitly discusses purveyance as one of the arbitrary services imposed on the yeomanry and notes its abolition as part of legal reforms in Great Britain.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate, as purveyance represents a specific regulatory mechanism of feudal governance that constrained economic activity through mandatory provision of goods and services.

vsm_relevance — 3.0 / 5.0

Purveyance maps reasonably well to S3 (internal regulation) as a control mechanism within the feudal system, though it also has S1 operational aspects in terms of resource extraction. However, it's primarily a historical regulatory practice rather than a core VSM concept.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illustrating a specific mechanism through which feudal systems extracted resources and burdened economic actors, helping explain the structural constraints on economic development that Smith analyzes.

3.2 KiB Raw Blame History