Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_circulation_limits

null

2026-02-23T00:37:24.406976

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly specifies what bank circulation limits are (maximum paper money that can circulate without instability) and provides concrete criteria for determining these limits (commerce needs and precious metal quantities). It avoids circularity and captures a distinct economic mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed analysis in Book II, Chapter 2, where he extensively discusses how banks must limit note issuance and the natural mechanisms that return excess circulation to banks. The concept reflects Smith's actual theoretical framework rather than imposing external ideas.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain placement as this concept deals with the regulatory constraints (both natural market forces and prudential limits) that govern banking operations. It represents a clear regulatory mechanism rather than belonging to production, exchange, or distribution domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation/audit) as it represents a control mechanism that maintains system stability through monitoring and limiting operations. It also has elements of S2 (coordination/anti-oscillation) in preventing monetary instability, making it clearly relevant to VSM systems.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial structural mechanism in Smith's monetary theory—how market forces naturally regulate money supply and what happens when banks exceed prudent limits. It explains the self-regulating nature of paper money circulation rather than merely naming a surface phenomenon.

Evaluation: Bank Circulation Limits

definition_precision — 4.0 / 5.0

The definition clearly specifies what bank circulation limits are (maximum paper money that can circulate without instability) and provides concrete criteria for determining these limits (commerce needs and precious metal quantities). It avoids circularity and captures a distinct economic mechanism rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed analysis in Book II, Chapter 2, where he extensively discusses how banks must limit note issuance and the natural mechanisms that return excess circulation to banks. The concept reflects Smith's actual theoretical framework rather than imposing external ideas.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain placement as this concept deals with the regulatory constraints (both natural market forces and prudential limits) that govern banking operations. It represents a clear regulatory mechanism rather than belonging to production, exchange, or distribution domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation/audit) as it represents a control mechanism that maintains system stability through monitoring and limiting operations. It also has elements of S2 (coordination/anti-oscillation) in preventing monetary instability, making it clearly relevant to VSM systems.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial structural mechanism in Smith's monetary theory—how market forces naturally regulate money supply and what happens when banks exceed prudent limits. It explains the self-regulating nature of paper money circulation rather than merely naming a surface phenomenon.

3.8 KiB Raw Blame History