Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

military_assistance

null

2026-02-23T05:52:16.275879

3.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes military assistance as organized provision of armed forces by towns with specific command structures, differentiating it from other forms of military service. It captures the reciprocal nature and political leverage aspects that make this a distinct concept rather than generic military obligation.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does discuss how towns provided military assistance to their protectors as part of reciprocal obligations in Book III, Chapter 3. The entity accurately reflects Smith's analysis of how economic privileges were balanced against civic duties in medieval political arrangements.

name	value	max_value	rationale
domain_placement	3.0	5.0	While "Regulation" captures the obligatory nature of military assistance, this concept spans multiple domains including political economy and governance structures. The regulatory aspect is present but may not be the primary conceptual home for this entity.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Military assistance maps reasonably well to S1 (operational capability that towns provided) and S3 (internal regulation of civic obligations), but the mapping is not as natural as purely economic or organizational concepts. It's more of a political-economic hybrid that doesn't have a clear VSM home.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important structural mechanism in Smith's analysis - how economic privileges were sustained through reciprocal military obligations, revealing the political foundations of early commercial development. It explains a key relationship rather than merely naming a surface phenomenon.

Evaluation: Military Assistance

definition_precision — 4.0 / 5.0

The definition clearly distinguishes military assistance as organized provision of armed forces by towns with specific command structures, differentiating it from other forms of military service. It captures the reciprocal nature and political leverage aspects that make this a distinct concept rather than generic military obligation.

source_grounding — 4.0 / 5.0

Smith does discuss how towns provided military assistance to their protectors as part of reciprocal obligations in Book III, Chapter 3. The entity accurately reflects Smith's analysis of how economic privileges were balanced against civic duties in medieval political arrangements.

domain_placement — 3.0 / 5.0

While "Regulation" captures the obligatory nature of military assistance, this concept spans multiple domains including political economy and governance structures. The regulatory aspect is present but may not be the primary conceptual home for this entity.

vsm_relevance — 3.0 / 5.0

Military assistance maps reasonably well to S1 (operational capability that towns provided) and S3 (internal regulation of civic obligations), but the mapping is not as natural as purely economic or organizational concepts. It's more of a political-economic hybrid that doesn't have a clear VSM home.

explanatory_value — 4.0 / 5.0

This entity illuminates an important structural mechanism in Smith's analysis - how economic privileges were sustained through reciprocal military obligations, revealing the political foundations of early commercial development. It explains a key relationship rather than merely naming a surface phenomenon.

3.6 KiB Raw Blame History