feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: water_pond_metaphor
evaluator: null
evaluated_at: '2026-02-23T06:38:45.664233'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures a specific analogy Smith uses to illustrate
banking equilibrium through water flow dynamics. It's precise in describing both
the metaphor itself and its intended meaning about balanced lending/repayment
cycles.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This is directly grounded in Smith's actual text from Book II, Chapter
2, where he explicitly uses this water-pond analogy to explain proper banking
operations. The entity accurately represents Smith's own illustrative device.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement since this metaphor
illustrates fundamental principles of banking and monetary circulation that underpin
Smith''s broader economic theory. It''s not specific to any particular economic
sector but explains systemic dynamics.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: The metaphor has moderate VSM relevance as it describes operational balance
(S1) and regulatory equilibrium (S3), but it's primarily an illustrative device
rather than a structural component. It explains how systems should function rather
than being a system itself.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory value by illuminating the mechanism
of banking equilibrium through a vivid, accessible analogy. It helps clarify the
structural relationship between bank reserves, lending, and repayments in maintaining
financial stability.
---
# Evaluation: Water Pond Metaphor
## definition_precision — 4.0 / 5.0
The definition clearly captures a specific analogy Smith uses to illustrate banking equilibrium through water flow dynamics. It's precise in describing both the metaphor itself and its intended meaning about balanced lending/repayment cycles.
## source_grounding — 5.0 / 5.0
This is directly grounded in Smith's actual text from Book II, Chapter 2, where he explicitly uses this water-pond analogy to explain proper banking operations. The entity accurately represents Smith's own illustrative device.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement since this metaphor illustrates fundamental principles of banking and monetary circulation that underpin Smith's broader economic theory. It's not specific to any particular economic sector but explains systemic dynamics.
## vsm_relevance — 3.0 / 5.0
The metaphor has moderate VSM relevance as it describes operational balance (S1) and regulatory equilibrium (S3), but it's primarily an illustrative device rather than a structural component. It explains how systems should function rather than being a system itself.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory value by illuminating the mechanism of banking equilibrium through a vivid, accessible analogy. It helps clarify the structural relationship between bank reserves, lending, and repayments in maintaining financial stability.