Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

statute_of_labourers

null

2026-02-23T06:25:26.779314

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and historically specific, clearly identifying the 1351 English law under Edward III that set maximum wages and prices following the Black Death. It captures a distinct regulatory instrument rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text, as he specifically references the Statute of Labourers in Book I, Chapter 11 as historical evidence for grain prices and silver values. The context accurately reflects Smith's use of this historical source.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is entirely appropriate, as the Statute of Labourers represents a clear example of government intervention in markets through price and wage controls. This fits perfectly within regulatory economic concepts.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	While the statute represents regulatory control (S3-like internal regulation), it functions more as historical data in Smith's analysis rather than as an active system component. It has some VSM relevance but is primarily used as empirical evidence rather than as a structural element.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory value by illustrating historical precedents for government market intervention and serving as concrete evidence for Smith's analysis of long-term price trends. It demonstrates the relationship between regulatory responses and economic disruptions like labor shortages.

Evaluation: Statute Of Labourers

definition_precision — 4.0 / 5.0

The definition is precise and historically specific, clearly identifying the 1351 English law under Edward III that set maximum wages and prices following the Black Death. It captures a distinct regulatory instrument rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text, as he specifically references the Statute of Labourers in Book I, Chapter 11 as historical evidence for grain prices and silver values. The context accurately reflects Smith's use of this historical source.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is entirely appropriate, as the Statute of Labourers represents a clear example of government intervention in markets through price and wage controls. This fits perfectly within regulatory economic concepts.

vsm_relevance — 3.0 / 5.0

While the statute represents regulatory control (S3-like internal regulation), it functions more as historical data in Smith's analysis rather than as an active system component. It has some VSM relevance but is primarily used as empirical evidence rather than as a structural element.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory value by illustrating historical precedents for government market intervention and serving as concrete evidence for Smith's analysis of long-term price trends. It demonstrates the relationship between regulatory responses and economic disruptions like labor shortages.

3.4 KiB Raw Blame History