Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_public_utility

null

2026-02-23T00:48:56.965842

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates the specific public utility functions of banks (facilitating commerce, reducing precious metal circulation, converting dead stock to productive capital) and acknowledges the balance with operational risks. It captures a distinct concept rather than being vague, though it could be slightly more precise about what constitutes "dead stock."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion in Book II, Chapter 2, where he explicitly analyzes how banks serve public utility through these specific mechanisms. Smith does indeed discuss the balance between banking utility and prudential concerns in this section.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept represents Smith's broader theoretical framework about how financial institutions function within the economic system. It's not a specific operational mechanism but rather a foundational principle of banking's role in the economy.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S1 (as banks are primary operations in the financial system) and S4 (as they provide intelligence about capital allocation and environmental adaptation). However, the concept is somewhat abstract and doesn't clearly belong to a single VSM system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides strong explanatory value by illuminating the structural mechanism through which banks contribute to economic efficiency and capital utilization. It explains not just what banks do, but why their function serves the broader economic system, though it could be more specific about the mechanisms involved.

Evaluation: Bank Public Utility

definition_precision — 4.0 / 5.0

The definition clearly articulates the specific public utility functions of banks (facilitating commerce, reducing precious metal circulation, converting dead stock to productive capital) and acknowledges the balance with operational risks. It captures a distinct concept rather than being vague, though it could be slightly more precise about what constitutes "dead stock."

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion in Book II, Chapter 2, where he explicitly analyzes how banks serve public utility through these specific mechanisms. Smith does indeed discuss the balance between banking utility and prudential concerns in this section.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept represents Smith's broader theoretical framework about how financial institutions function within the economic system. It's not a specific operational mechanism but rather a foundational principle of banking's role in the economy.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S1 (as banks are primary operations in the financial system) and S4 (as they provide intelligence about capital allocation and environmental adaptation). However, the concept is somewhat abstract and doesn't clearly belong to a single VSM system.

explanatory_value — 4.0 / 5.0

The entity provides strong explanatory value by illuminating the structural mechanism through which banks contribute to economic efficiency and capital utilization. It explains not just what banks do, but why their function serves the broader economic system, though it could be more specific about the mechanisms involved.

3.8 KiB Raw Blame History