feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: public_services_funding
evaluator: null
evaluated_at: '2026-02-23T06:14:13.338233'
overall_score: 4.0
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes public services funding as a specific
financial mechanism connecting revenue collection to state operations. It avoids
circularity and captures a distinct concept, though it could be slightly more
precise about the allocation mechanisms.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual text, particularly his
discussion of the state's need for revenue to fulfill its functions. The connection
between political economy's objective to supply state resources and public service
funding directly reflects Smith's framework.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "Regulation" domain is appropriate since public services funding
involves state regulatory and administrative functions. However, it could arguably
also belong in a "Public Finance" or "State Functions" domain if those existed.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S3 (internal
regulation through resource allocation) and S5 (policy implementation through
funding decisions). However, it's somewhat abstract and doesn't clearly align
with a single VSM system.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides good explanatory value by illuminating the crucial
mechanism linking economic systems to state capacity and public welfare provision.
It reveals an important structural relationship in Smith's political economy rather
than merely naming a surface phenomenon.
---
# Evaluation: Public Services Funding
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes public services funding as a specific financial mechanism connecting revenue collection to state operations. It avoids circularity and captures a distinct concept, though it could be slightly more precise about the allocation mechanisms.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual text, particularly his discussion of the state's need for revenue to fulfill its functions. The connection between political economy's objective to supply state resources and public service funding directly reflects Smith's framework.
## domain_placement — 4.0 / 5.0
The "Regulation" domain is appropriate since public services funding involves state regulatory and administrative functions. However, it could arguably also belong in a "Public Finance" or "State Functions" domain if those existed.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S3 (internal regulation through resource allocation) and S5 (policy implementation through funding decisions). However, it's somewhat abstract and doesn't clearly align with a single VSM system.
## explanatory_value — 4.0 / 5.0
The entity provides good explanatory value by illuminating the crucial mechanism linking economic systems to state capacity and public welfare provision. It reveals an important structural relationship in Smith's political economy rather than merely naming a surface phenomenon.