Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

standing_army

null

2026-02-23T06:25:01.902346

4.6

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly distinguishing standing armies from militia forces through specific criteria: permanent maintenance, professional soldiers, full-time service, and public funding. It captures a distinct military organizational concept with clear boundaries.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is thoroughly grounded in Smith's actual text, as Book V, Chapter 1 extensively discusses the evolution from militia to standing armies and their economic implications. Smith explicitly analyzes standing armies as a necessary but expensive form of military organization in advanced societies.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Regulation" domain is appropriate since standing armies represent state regulatory capacity and public expenditure decisions. However, it could also fit in a "Public Finance" or "Defense Economics" domain, as Smith treats it primarily as a fiscal and economic development issue.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Standing armies map well to S1 (primary operations of defense) and S3 (internal regulation/control of territory and population). They represent the state's operational capacity to maintain order and defend against external threats, which are core viable system functions.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural relationship between economic development, military specialization, and public finance. It reveals how advancing societies must trade militia flexibility for professional military effectiveness at considerable public expense.

Evaluation: Standing Army

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly distinguishing standing armies from militia forces through specific criteria: permanent maintenance, professional soldiers, full-time service, and public funding. It captures a distinct military organizational concept with clear boundaries.

source_grounding — 5.0 / 5.0

This entity is thoroughly grounded in Smith's actual text, as Book V, Chapter 1 extensively discusses the evolution from militia to standing armies and their economic implications. Smith explicitly analyzes standing armies as a necessary but expensive form of military organization in advanced societies.

domain_placement — 4.0 / 5.0

The "Regulation" domain is appropriate since standing armies represent state regulatory capacity and public expenditure decisions. However, it could also fit in a "Public Finance" or "Defense Economics" domain, as Smith treats it primarily as a fiscal and economic development issue.

vsm_relevance — 4.0 / 5.0

Standing armies map well to S1 (primary operations of defense) and S3 (internal regulation/control of territory and population). They represent the state's operational capacity to maintain order and defend against external threats, which are core viable system functions.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural relationship between economic development, military specialization, and public finance. It reveals how advancing societies must trade militia flexibility for professional military effectiveness at considerable public expense.

3.6 KiB Raw Blame History