Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_reserves

null

2026-02-23T00:49:46.946199

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly specifies bank reserves as gold and silver money held for note redemption, with precise functional criteria (meeting redemption demands) and key variables (circulation quantity, public confidence). It avoids circularity and captures a distinct operational concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed analysis of banking operations in Book II, Chapter 2, where he extensively discusses the relationship between note circulation, reserve requirements, and bank stability. The concept emerges naturally from Smith's examination of banking mechanics.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain placement, as bank reserves represent a regulatory mechanism that constrains and governs banking behavior. This is fundamentally about the internal controls and operational limits that ensure bank viability.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation/audit) as reserves function as an internal control mechanism that monitors and regulates bank operations. It also has some S2 relevance as a coordination mechanism that prevents oscillations between over-issuance and insolvency.

name	value	max_value	rationale
explanatory_value	5.0	5.0	Bank reserves illuminate a crucial structural mechanism in Smith's banking theory—how the constraint of maintaining adequate reserves creates a feedback loop that regulates note issuance and ensures system stability. This reveals the underlying mechanics of banking viability rather than just naming a surface phenomenon.

Evaluation: Bank Reserves

definition_precision — 4.0 / 5.0

The definition clearly specifies bank reserves as gold and silver money held for note redemption, with precise functional criteria (meeting redemption demands) and key variables (circulation quantity, public confidence). It avoids circularity and captures a distinct operational concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed analysis of banking operations in Book II, Chapter 2, where he extensively discusses the relationship between note circulation, reserve requirements, and bank stability. The concept emerges naturally from Smith's examination of banking mechanics.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain placement, as bank reserves represent a regulatory mechanism that constrains and governs banking behavior. This is fundamentally about the internal controls and operational limits that ensure bank viability.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation/audit) as reserves function as an internal control mechanism that monitors and regulates bank operations. It also has some S2 relevance as a coordination mechanism that prevents oscillations between over-issuance and insolvency.

explanatory_value — 5.0 / 5.0

Bank reserves illuminate a crucial structural mechanism in Smith's banking theory—how the constraint of maintaining adequate reserves creates a feedback loop that regulates note issuance and ensures system stability. This reveals the underlying mechanics of banking viability rather than just naming a surface phenomenon.

3.5 KiB Raw Blame History