Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_transaction_costs

null

2026-02-23T04:37:30.432045

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies specific banking expenses (note issuance, clearing, lending activities) and their economic impact. It avoids circularity and captures a distinct operational concept, though it could be slightly more precise about what constitutes "expenses associated with banking operations."

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does examine banking costs and their effects on economic efficiency in Book II, Chapter 2, particularly in his analysis of how banking innovations reduce operational expenses. The concept aligns well with his discussion of how banks contribute to capital accumulation through operational efficiency.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Accumulation" is the correct domain since transaction costs directly affect how efficiently banks facilitate capital formation and circulation. Smith's analysis of banking costs is fundamentally about their impact on the accumulation process.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S1 (operational costs of primary banking functions) and potentially S3 (internal efficiency monitoring). However, it's somewhat abstract as a cost concept rather than a clear systemic function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism in Smith's analysis—how operational costs affect banking's contribution to economic development. It explains a key factor in the efficiency of financial intermediation rather than merely naming a surface phenomenon.

Evaluation: Bank Transaction Costs

definition_precision — 4.0 / 5.0

The definition clearly identifies specific banking expenses (note issuance, clearing, lending activities) and their economic impact. It avoids circularity and captures a distinct operational concept, though it could be slightly more precise about what constitutes "expenses associated with banking operations."

source_grounding — 4.0 / 5.0

Smith does examine banking costs and their effects on economic efficiency in Book II, Chapter 2, particularly in his analysis of how banking innovations reduce operational expenses. The concept aligns well with his discussion of how banks contribute to capital accumulation through operational efficiency.

domain_placement — 5.0 / 5.0

"Accumulation" is the correct domain since transaction costs directly affect how efficiently banks facilitate capital formation and circulation. Smith's analysis of banking costs is fundamentally about their impact on the accumulation process.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S1 (operational costs of primary banking functions) and potentially S3 (internal efficiency monitoring). However, it's somewhat abstract as a cost concept rather than a clear systemic function.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism in Smith's analysis—how operational costs affect banking's contribution to economic development. It explains a key factor in the efficiency of financial intermediation rather than merely naming a surface phenomenon.

3.4 KiB Raw Blame History