Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

military_discipline

null

2026-02-23T05:52:34.855446

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes military discipline as an organized system of civic defense obligations, specifically detailing night watch and wall defense duties. It avoids circularity and captures a distinct concept rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion of the obligations that accompanied the privileges granted to free burghs in Book III, Chapter 3. The concept directly reflects Smith's analysis of how urban autonomy came with defensive responsibilities.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Regulation" domain is appropriate since military discipline represents a formal system of civic obligations and organized duties. While it has military aspects, it functions primarily as a regulatory mechanism governing citizen behavior and urban governance.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps reasonably well to S3 (internal regulation) as it represents internal control mechanisms for urban communities, though it also has elements of S1 (operational defense activities). The VSM mapping is present but not exceptionally strong.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural mechanism in Smith's analysis - how urban freedoms were balanced by civic obligations, creating a reciprocal relationship between liberty and duty. This adds genuine insight into the institutional arrangements of medieval urban governance.

Evaluation: Military Discipline

definition_precision — 4.0 / 5.0

The definition clearly distinguishes military discipline as an organized system of civic defense obligations, specifically detailing night watch and wall defense duties. It avoids circularity and captures a distinct concept rather than being a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion of the obligations that accompanied the privileges granted to free burghs in Book III, Chapter 3. The concept directly reflects Smith's analysis of how urban autonomy came with defensive responsibilities.

domain_placement — 4.0 / 5.0

The "Regulation" domain is appropriate since military discipline represents a formal system of civic obligations and organized duties. While it has military aspects, it functions primarily as a regulatory mechanism governing citizen behavior and urban governance.

vsm_relevance — 3.0 / 5.0

This entity maps reasonably well to S3 (internal regulation) as it represents internal control mechanisms for urban communities, though it also has elements of S1 (operational defense activities). The VSM mapping is present but not exceptionally strong.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural mechanism in Smith's analysis - how urban freedoms were balanced by civic obligations, creating a reciprocal relationship between liberty and duty. This adds genuine insight into the institutional arrangements of medieval urban governance.

3.3 KiB Raw Blame History