Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_economic_stability

null

2026-02-23T00:40:04.160033

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies three specific components of banking stability (reserves, lending practices, note circulation) and establishes their relationship to broader economic outcomes. While "appropriate" and "prudent" could be more precise, the definition avoids circularity and captures a distinct concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analysis in Book II, Chapter 2, where he extensively discusses banking practices, reserve requirements, and the effects of stable versus unstable banking on economic development. Smith explicitly connects banking stability to broader economic outcomes.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as banking stability represents a foundational theoretical concept that underpins Smith's broader economic framework rather than belonging to a specific operational area. This concept cuts across multiple economic functions and systems.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to VSM System 2 (coordination/anti-oscillation) as banking stability serves to dampen economic fluctuations and coordinate financial flows throughout the economy. It also has elements of S3 (internal regulation) through prudent practices and reserve management.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanism through which banking practices either support or destabilize economic development. It reveals how financial system stability creates the foundation for broader economic coordination and growth.

Evaluation: Bank Economic Stability

definition_precision — 4.0 / 5.0

The definition clearly identifies three specific components of banking stability (reserves, lending practices, note circulation) and establishes their relationship to broader economic outcomes. While "appropriate" and "prudent" could be more precise, the definition avoids circularity and captures a distinct concept.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analysis in Book II, Chapter 2, where he extensively discusses banking practices, reserve requirements, and the effects of stable versus unstable banking on economic development. Smith explicitly connects banking stability to broader economic outcomes.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as banking stability represents a foundational theoretical concept that underpins Smith's broader economic framework rather than belonging to a specific operational area. This concept cuts across multiple economic functions and systems.

vsm_relevance — 4.0 / 5.0

This entity maps well to VSM System 2 (coordination/anti-oscillation) as banking stability serves to dampen economic fluctuations and coordinate financial flows throughout the economy. It also has elements of S3 (internal regulation) through prudent practices and reserve management.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanism through which banking practices either support or destabilize economic development. It reveals how financial system stability creates the foundation for broader economic coordination and growth.

3.6 KiB Raw Blame History