Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_financial_system_stability

null

2026-02-23T00:42:17.203459

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about financial system stability but remains somewhat broad and umbrella-like. While it identifies key components (banks, financial institutions, regulation), it could be more precise about what constitutes "stability" and "essential financial services."

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does indeed analyze banking and financial stability in Book II, Chapter 2, discussing how banks should operate prudently and the conditions for financial system soundness. The entity accurately reflects Smith's concerns about banking regulation and systemic stability.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain placement, as Smith's discussion of financial system stability is fundamentally about the need for appropriate regulatory frameworks and market discipline to maintain banking soundness.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation/audit) as it concerns the regulatory mechanisms needed to maintain system stability, and partially to S2 (coordination/anti-oscillation) as financial stability involves dampening destabilizing fluctuations across the financial system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory value by illuminating the structural relationship between regulation, market discipline, and economic development. It captures an important mechanism Smith identifies for how financial systems can support broader economic growth through stability.

Evaluation: Bank Financial System Stability

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about financial system stability but remains somewhat broad and umbrella-like. While it identifies key components (banks, financial institutions, regulation), it could be more precise about what constitutes "stability" and "essential financial services."

source_grounding — 4.0 / 5.0

Smith does indeed analyze banking and financial stability in Book II, Chapter 2, discussing how banks should operate prudently and the conditions for financial system soundness. The entity accurately reflects Smith's concerns about banking regulation and systemic stability.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain placement, as Smith's discussion of financial system stability is fundamentally about the need for appropriate regulatory frameworks and market discipline to maintain banking soundness.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation/audit) as it concerns the regulatory mechanisms needed to maintain system stability, and partially to S2 (coordination/anti-oscillation) as financial stability involves dampening destabilizing fluctuations across the financial system.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory value by illuminating the structural relationship between regulation, market discipline, and economic development. It captures an important mechanism Smith identifies for how financial systems can support broader economic growth through stability.

3.4 KiB Raw Blame History