Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

ejectment_action

null

2026-02-23T05:22:50.401351

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes ejectment action from ordinary damages by specifying it allows recovery of actual possession, not just compensation. It precisely identifies the key feature that made this legal remedy distinctive and economically significant.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis in Book III, Chapter 2, where he explicitly discusses how English legal protections for tenants, including remedies against wrongful ouster, contributed to agricultural improvement. The contrast with continental practices is also textually supported.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain placement, as this represents a specific legal-institutional mechanism that shapes economic behavior. It's neither a pure market phenomenon nor a broad policy concept, but rather a concrete regulatory tool.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S3 (internal regulation) as it represents an institutional mechanism that maintains system stability by protecting property rights and encouraging investment. It could also relate to S2 as it prevents oscillations between investment and disinvestment caused by tenure insecurity.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a specific causal mechanism in Smith's argument about why English agriculture outperformed continental systems - the legal security that encouraged tenant investment in improvements. It explains how institutional design translates into economic outcomes rather than merely naming a surface phenomenon.

Evaluation: Ejectment Action

definition_precision — 4.0 / 5.0

The definition clearly distinguishes ejectment action from ordinary damages by specifying it allows recovery of actual possession, not just compensation. It precisely identifies the key feature that made this legal remedy distinctive and economically significant.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis in Book III, Chapter 2, where he explicitly discusses how English legal protections for tenants, including remedies against wrongful ouster, contributed to agricultural improvement. The contrast with continental practices is also textually supported.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain placement, as this represents a specific legal-institutional mechanism that shapes economic behavior. It's neither a pure market phenomenon nor a broad policy concept, but rather a concrete regulatory tool.

vsm_relevance — 4.0 / 5.0

This maps well to S3 (internal regulation) as it represents an institutional mechanism that maintains system stability by protecting property rights and encouraging investment. It could also relate to S2 as it prevents oscillations between investment and disinvestment caused by tenure insecurity.

explanatory_value — 5.0 / 5.0

This entity illuminates a specific causal mechanism in Smith's argument about why English agriculture outperformed continental systems - the legal security that encouraged tenant investment in improvements. It explains how institutional design translates into economic outcomes rather than merely naming a surface phenomenon.

3.5 KiB Raw Blame History