feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: statute_of_labourers
evaluator: null
evaluated_at: '2026-02-23T06:25:26.779314'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is precise and historically specific, clearly identifying
the 1351 English law under Edward III that set maximum wages and prices following
the Black Death. It captures a distinct regulatory instrument rather than a vague
concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual text, as he specifically
references the Statute of Labourers in Book I, Chapter 11 as historical evidence
for grain prices and silver values. The context accurately reflects Smith's use
of this historical source.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain assignment is entirely appropriate, as the Statute
of Labourers represents a clear example of government intervention in markets
through price and wage controls. This fits perfectly within regulatory economic
concepts.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: While the statute represents regulatory control (S3-like internal regulation),
it functions more as historical data in Smith's analysis rather than as an active
system component. It has some VSM relevance but is primarily used as empirical
evidence rather than as a structural element.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory value by illustrating historical
precedents for government market intervention and serving as concrete evidence
for Smith's analysis of long-term price trends. It demonstrates the relationship
between regulatory responses and economic disruptions like labor shortages.
---
# Evaluation: Statute Of Labourers
## definition_precision — 4.0 / 5.0
The definition is precise and historically specific, clearly identifying the 1351 English law under Edward III that set maximum wages and prices following the Black Death. It captures a distinct regulatory instrument rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual text, as he specifically references the Statute of Labourers in Book I, Chapter 11 as historical evidence for grain prices and silver values. The context accurately reflects Smith's use of this historical source.
## domain_placement — 5.0 / 5.0
The "Regulation" domain assignment is entirely appropriate, as the Statute of Labourers represents a clear example of government intervention in markets through price and wage controls. This fits perfectly within regulatory economic concepts.
## vsm_relevance — 3.0 / 5.0
While the statute represents regulatory control (S3-like internal regulation), it functions more as historical data in Smith's analysis rather than as an active system component. It has some VSM relevance but is primarily used as empirical evidence rather than as a structural element.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory value by illustrating historical precedents for government market intervention and serving as concrete evidence for Smith's analysis of long-term price trends. It demonstrates the relationship between regulatory responses and economic disruptions like labor shortages.