feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: bank_public_utility
evaluator: null
evaluated_at: '2026-02-23T00:48:56.965842'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly articulates the specific public utility functions
of banks (facilitating commerce, reducing precious metal circulation, converting
dead stock to productive capital) and acknowledges the balance with operational
risks. It captures a distinct concept rather than being vague, though it could
be slightly more precise about what constitutes "dead stock."
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual discussion in Book II,
Chapter 2, where he explicitly analyzes how banks serve public utility through
these specific mechanisms. Smith does indeed discuss the balance between banking
utility and prudential concerns in this section.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this concept
represents Smith''s broader theoretical framework about how financial institutions
function within the economic system. It''s not a specific operational mechanism
but rather a foundational principle of banking''s role in the economy.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S1 (as
banks are primary operations in the financial system) and S4 (as they provide
intelligence about capital allocation and environmental adaptation). However,
the concept is somewhat abstract and doesn't clearly belong to a single VSM system.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides strong explanatory value by illuminating the structural
mechanism through which banks contribute to economic efficiency and capital utilization.
It explains not just what banks do, but why their function serves the broader
economic system, though it could be more specific about the mechanisms involved.
---
# Evaluation: Bank Public Utility
## definition_precision — 4.0 / 5.0
The definition clearly articulates the specific public utility functions of banks (facilitating commerce, reducing precious metal circulation, converting dead stock to productive capital) and acknowledges the balance with operational risks. It captures a distinct concept rather than being vague, though it could be slightly more precise about what constitutes "dead stock."
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual discussion in Book II, Chapter 2, where he explicitly analyzes how banks serve public utility through these specific mechanisms. Smith does indeed discuss the balance between banking utility and prudential concerns in this section.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this concept represents Smith's broader theoretical framework about how financial institutions function within the economic system. It's not a specific operational mechanism but rather a foundational principle of banking's role in the economy.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S1 (as banks are primary operations in the financial system) and S4 (as they provide intelligence about capital allocation and environmental adaptation). However, the concept is somewhat abstract and doesn't clearly belong to a single VSM system.
## explanatory_value — 4.0 / 5.0
The entity provides strong explanatory value by illuminating the structural mechanism through which banks contribute to economic efficiency and capital utilization. It explains not just what banks do, but why their function serves the broader economic system, though it could be more specific about the mechanisms involved.