Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_assemblies

null

2026-02-23T04:52:26.418250

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies colony assemblies as specific legislative bodies with distinct characteristics (elected representatives, tax authority, local regulation) and distinguishes them from other governmental forms. The definition avoids circularity and captures the essential features that make these bodies significant in Smith's analysis.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed discussion in Book IV, Chapter 7, where he extensively analyzes colonial assemblies' role in taxation and their relationship to imperial governance. Smith explicitly discusses their claims to parliamentary-like powers and their resistance to external taxation.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate, as colony assemblies function as regulatory institutions that impose taxes, create local laws, and govern colonial affairs. Their regulatory nature is central to Smith's analysis of colonial administration and imperial fiscal policy.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Colony assemblies map well to S3 (internal regulation) within the colonial subsystem, as they audit and regulate local affairs, and potentially to S4 (intelligence) as they gather local information for governance decisions. Their role as intermediary regulatory bodies between local operations and imperial oversight gives them clear VSM positioning.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates a crucial structural mechanism in Smith's analysis of imperial governance—how local legislative bodies create tension between colonial self-governance and imperial fiscal needs. It helps explain the systemic problems Smith identifies with colonial taxation and his proposed solution of parliamentary representation.

Evaluation: Colony Assemblies

definition_precision — 4.0 / 5.0

The definition clearly identifies colony assemblies as specific legislative bodies with distinct characteristics (elected representatives, tax authority, local regulation) and distinguishes them from other governmental forms. The definition avoids circularity and captures the essential features that make these bodies significant in Smith's analysis.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed discussion in Book IV, Chapter 7, where he extensively analyzes colonial assemblies' role in taxation and their relationship to imperial governance. Smith explicitly discusses their claims to parliamentary-like powers and their resistance to external taxation.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate, as colony assemblies function as regulatory institutions that impose taxes, create local laws, and govern colonial affairs. Their regulatory nature is central to Smith's analysis of colonial administration and imperial fiscal policy.

vsm_relevance — 4.0 / 5.0

Colony assemblies map well to S3 (internal regulation) within the colonial subsystem, as they audit and regulate local affairs, and potentially to S4 (intelligence) as they gather local information for governance decisions. Their role as intermediary regulatory bodies between local operations and imperial oversight gives them clear VSM positioning.

explanatory_value — 4.0 / 5.0

This entity illuminates a crucial structural mechanism in Smith's analysis of imperial governance—how local legislative bodies create tension between colonial self-governance and imperial fiscal needs. It helps explain the systemic problems Smith identifies with colonial taxation and his proposed solution of parliamentary representation.

4.0 KiB Raw Blame History