Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

country_gentlemen

null

2026-02-23T05:04:01.427800

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly distinguishing country gentlemen from other borrowers by their specific pattern of borrowing to replace already-consumed capital rather than for immediate consumption or new investment. The distinction between capital replacement versus capital creation is well-articulated and non-circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book II, Chapter 4, where he specifically analyzes different types of borrowers and their economic effects. Smith explicitly discusses landowners who borrow against mortgages to replace capital they've consumed through credit arrangements, making this a faithful representation of his analysis.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Distribution" domain is perfectly appropriate since this concept deals with how capital flows between different economic actors (lenders to landowners) and the distributional effects of different borrowing patterns. This is fundamentally about the circulation and allocation of capital in the economy.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity represents a specific economic actor type rather than a systemic function, making it difficult to map naturally to any particular VSM system. While country gentlemen participate in the economic system, they don't embody a distinct regulatory, operational, or intelligence function that would align with S1-S5.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illuminating a specific mechanism of capital circulation and helping explain why certain types of lending relationships persist despite low profitability. It reveals an important structural distinction in how different borrowers relate to capital formation versus capital replacement.

Evaluation: Country Gentlemen

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly distinguishing country gentlemen from other borrowers by their specific pattern of borrowing to replace already-consumed capital rather than for immediate consumption or new investment. The distinction between capital replacement versus capital creation is well-articulated and non-circular.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book II, Chapter 4, where he specifically analyzes different types of borrowers and their economic effects. Smith explicitly discusses landowners who borrow against mortgages to replace capital they've consumed through credit arrangements, making this a faithful representation of his analysis.

domain_placement — 5.0 / 5.0

The "Distribution" domain is perfectly appropriate since this concept deals with how capital flows between different economic actors (lenders to landowners) and the distributional effects of different borrowing patterns. This is fundamentally about the circulation and allocation of capital in the economy.

vsm_relevance — 2.0 / 5.0

This entity represents a specific economic actor type rather than a systemic function, making it difficult to map naturally to any particular VSM system. While country gentlemen participate in the economic system, they don't embody a distinct regulatory, operational, or intelligence function that would align with S1-S5.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illuminating a specific mechanism of capital circulation and helping explain why certain types of lending relationships persist despite low profitability. It reveals an important structural distinction in how different borrowers relate to capital formation versus capital replacement.

4.0 KiB Raw Blame History