Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

feudal_anarchy

null

2026-02-23T05:28:07.442163

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies feudal anarchy as a specific historical period with distinct characteristics (absence of centralized authority, local lords exercising multiple powers). It avoids circularity and captures a concrete political-economic arrangement rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's historical analysis in Book III, Chapter 2, where he explicitly discusses the post-Roman period and its impact on property arrangements. The connection to primogeniture and entails as defensive necessities is faithful to Smith's argument.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate as this represents Smith's broader theoretical framework about institutional evolution and property systems. It could potentially fit in a more specific historical or institutional domain, but General Theory captures its role in Smith's overarching analysis.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This historical condition is largely VSM-neutral, describing a breakdown of systemic organization rather than mapping to specific VSM functions. It represents the absence or failure of viable system structures rather than their operation.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides crucial explanatory power for understanding why certain property institutions (primogeniture, entails) emerged and persisted. It illuminates the structural relationship between political disorder and economic arrangements in Smith's historical analysis.

Evaluation: Feudal Anarchy

definition_precision — 4.0 / 5.0

The definition clearly identifies feudal anarchy as a specific historical period with distinct characteristics (absence of centralized authority, local lords exercising multiple powers). It avoids circularity and captures a concrete political-economic arrangement rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's historical analysis in Book III, Chapter 2, where he explicitly discusses the post-Roman period and its impact on property arrangements. The connection to primogeniture and entails as defensive necessities is faithful to Smith's argument.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate as this represents Smith's broader theoretical framework about institutional evolution and property systems. It could potentially fit in a more specific historical or institutional domain, but General Theory captures its role in Smith's overarching analysis.

vsm_relevance — 2.0 / 5.0

This historical condition is largely VSM-neutral, describing a breakdown of systemic organization rather than mapping to specific VSM functions. It represents the absence or failure of viable system structures rather than their operation.

explanatory_value — 5.0 / 5.0

This entity provides crucial explanatory power for understanding why certain property institutions (primogeniture, entails) emerged and persisted. It illuminates the structural relationship between political disorder and economic arrangements in Smith's historical analysis.

3.4 KiB Raw Blame History