Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_credit_extension

null

2026-02-23T00:37:58.889403

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies bank credit extension as a specific practice involving discounting bills, cash accounts, and note issuance, distinguishing it from general banking activities. It captures the core concept without circularity, though it could be slightly more precise about the mechanisms involved.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed analysis in Book II, Chapter 2, where he extensively examines banking practices, credit extension methods, and their economic effects. The concept reflects Smith's actual discussion rather than imposing modern interpretations.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since bank credit extension is fundamentally about facilitating trade and commerce through financial intermediation. This placement aligns with Smith's treatment of banking as part of the broader exchange system.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations of the banking system) and S2 (coordination function in facilitating trade flows). The regulatory aspects Smith discusses also connect to S3 functions, making it highly relevant to VSM analysis.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial mechanism in Smith's economic system - how banks amplify capital circulation and facilitate trade beyond what specie alone could support. It explains structural relationships between banking, commerce, and economic growth rather than merely naming a surface phenomenon.

Evaluation: Bank Credit Extension

definition_precision — 4.0 / 5.0

The definition clearly identifies bank credit extension as a specific practice involving discounting bills, cash accounts, and note issuance, distinguishing it from general banking activities. It captures the core concept without circularity, though it could be slightly more precise about the mechanisms involved.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed analysis in Book II, Chapter 2, where he extensively examines banking practices, credit extension methods, and their economic effects. The concept reflects Smith's actual discussion rather than imposing modern interpretations.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since bank credit extension is fundamentally about facilitating trade and commerce through financial intermediation. This placement aligns with Smith's treatment of banking as part of the broader exchange system.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations of the banking system) and S2 (coordination function in facilitating trade flows). The regulatory aspects Smith discusses also connect to S3 functions, making it highly relevant to VSM analysis.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial mechanism in Smith's economic system - how banks amplify capital circulation and facilitate trade beyond what specie alone could support. It explains structural relationships between banking, commerce, and economic growth rather than merely naming a surface phenomenon.

3.5 KiB Raw Blame History