Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

public_services_funding

null

2026-02-23T06:14:13.338233

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes public services funding as a specific financial mechanism connecting revenue collection to state operations. It avoids circularity and captures a distinct concept, though it could be slightly more precise about the allocation mechanisms.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text, particularly his discussion of the state's need for revenue to fulfill its functions. The connection between political economy's objective to supply state resources and public service funding directly reflects Smith's framework.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Regulation" domain is appropriate since public services funding involves state regulatory and administrative functions. However, it could arguably also belong in a "Public Finance" or "State Functions" domain if those existed.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S3 (internal regulation through resource allocation) and S5 (policy implementation through funding decisions). However, it's somewhat abstract and doesn't clearly align with a single VSM system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides good explanatory value by illuminating the crucial mechanism linking economic systems to state capacity and public welfare provision. It reveals an important structural relationship in Smith's political economy rather than merely naming a surface phenomenon.

Evaluation: Public Services Funding

definition_precision — 4.0 / 5.0

The definition clearly distinguishes public services funding as a specific financial mechanism connecting revenue collection to state operations. It avoids circularity and captures a distinct concept, though it could be slightly more precise about the allocation mechanisms.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text, particularly his discussion of the state's need for revenue to fulfill its functions. The connection between political economy's objective to supply state resources and public service funding directly reflects Smith's framework.

domain_placement — 4.0 / 5.0

The "Regulation" domain is appropriate since public services funding involves state regulatory and administrative functions. However, it could arguably also belong in a "Public Finance" or "State Functions" domain if those existed.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S3 (internal regulation through resource allocation) and S5 (policy implementation through funding decisions). However, it's somewhat abstract and doesn't clearly align with a single VSM system.

explanatory_value — 4.0 / 5.0

The entity provides good explanatory value by illuminating the crucial mechanism linking economic systems to state capacity and public welfare provision. It reveals an important structural relationship in Smith's political economy rather than merely naming a surface phenomenon.

3.3 KiB Raw Blame History