Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

militia

null

2026-02-23T05:52:52.927092

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes militia from standing armies through specific characteristics: part-time service, civilian occupations maintained, self-funded subsistence, and periodic training. The definition is precise and non-circular, capturing a distinct military organizational form.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion of military organization in Book V, Chapter 1, where he explicitly contrasts militia with standing armies as two fundamental approaches to public defense. The characteristics described align closely with Smith's analysis of how militias function in different stages of societal development.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Regulation" is appropriate as militia represents a regulatory mechanism for public defense, one of the essential functions of government that Smith discusses. However, it could also fit under a "Public Goods" or "Defense" domain, though regulation captures the institutional aspect well.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Militia maps reasonably to S1 (primary operations) as it represents an operational capability for defense, but it also has S3 elements as a regulatory mechanism for maintaining social order. The mapping is not as clear-cut as some other entities, making it moderately VSM-relevant.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important structural mechanism in Smith's analysis of how societies organize defense functions, particularly the trade-offs between citizen-soldiers and professional armies. It reveals underlying economic principles about how military capability relates to economic development and state capacity.

Evaluation: Militia

definition_precision — 4.0 / 5.0

The definition clearly distinguishes militia from standing armies through specific characteristics: part-time service, civilian occupations maintained, self-funded subsistence, and periodic training. The definition is precise and non-circular, capturing a distinct military organizational form.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion of military organization in Book V, Chapter 1, where he explicitly contrasts militia with standing armies as two fundamental approaches to public defense. The characteristics described align closely with Smith's analysis of how militias function in different stages of societal development.

domain_placement — 4.0 / 5.0

"Regulation" is appropriate as militia represents a regulatory mechanism for public defense, one of the essential functions of government that Smith discusses. However, it could also fit under a "Public Goods" or "Defense" domain, though regulation captures the institutional aspect well.

vsm_relevance — 3.0 / 5.0

Militia maps reasonably to S1 (primary operations) as it represents an operational capability for defense, but it also has S3 elements as a regulatory mechanism for maintaining social order. The mapping is not as clear-cut as some other entities, making it moderately VSM-relevant.

explanatory_value — 4.0 / 5.0

This entity illuminates an important structural mechanism in Smith's analysis of how societies organize defense functions, particularly the trade-offs between citizen-soldiers and professional armies. It reveals underlying economic principles about how military capability relates to economic development and state capacity.

3.7 KiB Raw Blame History