Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

water_pond_metaphor

null

2026-02-23T06:38:45.664233

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures a specific analogy Smith uses to illustrate banking equilibrium through water flow dynamics. It's precise in describing both the metaphor itself and its intended meaning about balanced lending/repayment cycles.

name	value	max_value	rationale
source_grounding	5.0	5.0	This is directly grounded in Smith's actual text from Book II, Chapter 2, where he explicitly uses this water-pond analogy to explain proper banking operations. The entity accurately represents Smith's own illustrative device.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since this metaphor illustrates fundamental principles of banking and monetary circulation that underpin Smith's broader economic theory. It's not specific to any particular economic sector but explains systemic dynamics.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	The metaphor has moderate VSM relevance as it describes operational balance (S1) and regulatory equilibrium (S3), but it's primarily an illustrative device rather than a structural component. It explains how systems should function rather than being a system itself.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory value by illuminating the mechanism of banking equilibrium through a vivid, accessible analogy. It helps clarify the structural relationship between bank reserves, lending, and repayments in maintaining financial stability.

Evaluation: Water Pond Metaphor

definition_precision — 4.0 / 5.0

The definition clearly captures a specific analogy Smith uses to illustrate banking equilibrium through water flow dynamics. It's precise in describing both the metaphor itself and its intended meaning about balanced lending/repayment cycles.

source_grounding — 5.0 / 5.0

This is directly grounded in Smith's actual text from Book II, Chapter 2, where he explicitly uses this water-pond analogy to explain proper banking operations. The entity accurately represents Smith's own illustrative device.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since this metaphor illustrates fundamental principles of banking and monetary circulation that underpin Smith's broader economic theory. It's not specific to any particular economic sector but explains systemic dynamics.

vsm_relevance — 3.0 / 5.0

The metaphor has moderate VSM relevance as it describes operational balance (S1) and regulatory equilibrium (S3), but it's primarily an illustrative device rather than a structural component. It explains how systems should function rather than being a system itself.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory value by illuminating the mechanism of banking equilibrium through a vivid, accessible analogy. It helps clarify the structural relationship between bank reserves, lending, and repayments in maintaining financial stability.

3.2 KiB Raw Blame History