Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

settlement_laws

null

2026-02-23T06:21:14.156094

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and specific, clearly describing settlement laws as legal provisions requiring official parish settlement before residence, with explicit mention of their barrier effects on labor mobility. It captures a distinct regulatory mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 10, where he extensively discusses settlement laws as obstacles to labor circulation and criticizes them as harmful English regulations. The characterization aligns closely with Smith's actual arguments about these laws preventing natural wage adjustments.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate, as settlement laws are explicitly legal/regulatory mechanisms that constrain market operations. This represents a clear case of government regulation interfering with natural economic processes.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Settlement laws map well to S3 (internal regulation) as they represent regulatory constraints on system operations, and also connect to S2 (coordination) since they disrupt the natural coordination mechanism of labor mobility. The regulatory nature gives it clear VSM relevance rather than being abstract.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating a specific mechanism through which government regulation distorts labor markets and prevents efficient resource allocation. It demonstrates how legal structures can create structural barriers to the natural functioning of economic systems.

Evaluation: Settlement Laws

definition_precision — 5.0 / 5.0

The definition is highly precise and specific, clearly describing settlement laws as legal provisions requiring official parish settlement before residence, with explicit mention of their barrier effects on labor mobility. It captures a distinct regulatory mechanism rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 10, where he extensively discusses settlement laws as obstacles to labor circulation and criticizes them as harmful English regulations. The characterization aligns closely with Smith's actual arguments about these laws preventing natural wage adjustments.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate, as settlement laws are explicitly legal/regulatory mechanisms that constrain market operations. This represents a clear case of government regulation interfering with natural economic processes.

vsm_relevance — 4.0 / 5.0

Settlement laws map well to S3 (internal regulation) as they represent regulatory constraints on system operations, and also connect to S2 (coordination) since they disrupt the natural coordination mechanism of labor mobility. The regulatory nature gives it clear VSM relevance rather than being abstract.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating a specific mechanism through which government regulation distorts labor markets and prevents efficient resource allocation. It demonstrates how legal structures can create structural barriers to the natural functioning of economic systems.

3.6 KiB Raw Blame History