feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: expense_of_justice
evaluator: null
evaluated_at: '2026-02-23T05:25:30.012556'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is precise and captures a distinct concept - the sovereign's
specific financial responsibility for maintaining justice administration. It clearly
delineates this as protection from "injustice or oppression" rather than using
vague terms, though it could be slightly more specific about what constitutes
"exact administration."
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text from Book V, Chapter
1, where he explicitly discusses the sovereign's duty to establish justice administration
as the second primary obligation. The language and conceptual framework align
closely with Smith's original exposition of sovereign duties.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain assignment is correct, as this represents the
sovereign's regulatory function in establishing and maintaining institutional
frameworks for justice. This fits perfectly within the broader category of governmental
regulation of social and economic relations.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S3 (internal regulation/audit) as it represents
the system's mechanism for maintaining internal order and ensuring compliance
with established rules. It also has elements of S2 (coordination) in preventing
conflicts between societal members.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by illuminating the structural
mechanism through which civil government maintains social order and protects property
rights. It reveals the economic logic behind justice administration as a foundational
requirement for market functioning, though it could elaborate more on the specific
mechanisms involved.
---
# Evaluation: Expense Of Justice
## definition_precision — 4.0 / 5.0
The definition is precise and captures a distinct concept - the sovereign's specific financial responsibility for maintaining justice administration. It clearly delineates this as protection from "injustice or oppression" rather than using vague terms, though it could be slightly more specific about what constitutes "exact administration."
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text from Book V, Chapter 1, where he explicitly discusses the sovereign's duty to establish justice administration as the second primary obligation. The language and conceptual framework align closely with Smith's original exposition of sovereign duties.
## domain_placement — 5.0 / 5.0
The "Regulation" domain assignment is correct, as this represents the sovereign's regulatory function in establishing and maintaining institutional frameworks for justice. This fits perfectly within the broader category of governmental regulation of social and economic relations.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S3 (internal regulation/audit) as it represents the system's mechanism for maintaining internal order and ensuring compliance with established rules. It also has elements of S2 (coordination) in preventing conflicts between societal members.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by illuminating the structural mechanism through which civil government maintains social order and protects property rights. It reveals the economic logic behind justice administration as a foundational requirement for market functioning, though it could elaborate more on the specific mechanisms involved.