Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

unfunded_debt

null

2026-02-23T06:35:06.946322

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes unfunded debt from funded debt by the absence of dedicated revenue streams, and specifies it includes short-term obligations and arrears. The definition is precise and non-circular, though it could be slightly more specific about the temporal aspects.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's explicit discussion in Book V, Chapter 3, where he systematically distinguishes between funded and unfunded debt as fundamental categories of government borrowing. Smith clearly presents this as the first method governments use when contracting debt.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is appropriate since this concerns government debt management and fiscal policy mechanisms. Unfunded debt represents a regulatory/administrative approach to government finance rather than a market mechanism or production concept.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation) as it represents a specific regulatory mechanism for government financial management, and potentially to S2 (coordination) as it affects how governments coordinate their financial obligations. It has clear operational relevance rather than being abstractly theoretical.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural mechanism in government finance - how debt obligations can be contracted without dedicated repayment sources, creating specific fiscal dynamics and constraints. This explains a concrete governmental financial practice rather than merely naming a surface phenomenon.

Evaluation: Unfunded Debt

definition_precision — 4.0 / 5.0

The definition clearly distinguishes unfunded debt from funded debt by the absence of dedicated revenue streams, and specifies it includes short-term obligations and arrears. The definition is precise and non-circular, though it could be slightly more specific about the temporal aspects.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's explicit discussion in Book V, Chapter 3, where he systematically distinguishes between funded and unfunded debt as fundamental categories of government borrowing. Smith clearly presents this as the first method governments use when contracting debt.

domain_placement — 5.0 / 5.0

The "Regulation" domain is appropriate since this concerns government debt management and fiscal policy mechanisms. Unfunded debt represents a regulatory/administrative approach to government finance rather than a market mechanism or production concept.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation) as it represents a specific regulatory mechanism for government financial management, and potentially to S2 (coordination) as it affects how governments coordinate their financial obligations. It has clear operational relevance rather than being abstractly theoretical.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural mechanism in government finance - how debt obligations can be contracted without dedicated repayment sources, creating specific fiscal dynamics and constraints. This explains a concrete governmental financial practice rather than merely naming a surface phenomenon.

3.6 KiB Raw Blame History