Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

requisite_variety_in_banking

null

2026-02-23T06:17:25.652373

2.6

name	value	max_value	rationale
definition_precision	2.0	5.0	The definition conflates the cybernetic concept of "requisite variety" (from Ashby's Law) with basic banking prudence, creating conceptual confusion. Smith discusses banking reserves and lending practices but does not frame these in terms of matching "variety of demands" in the cybernetic sense.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss banking reserves and prudent lending in Book II, Chapter 2, he does not use or imply the concept of "requisite variety" as a organizing principle. This appears to be a modern cybernetic framework imposed on Smith's more straightforward discussion of banking stability.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Regulation" domain is appropriate since Smith's discussion of banking practices in this chapter does concern regulatory and stability issues. The banking context is also correctly identified from the source material.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	The entity could map to S3 (internal regulation) given its focus on maintaining stability through reserves and lending practices. However, the forced cybernetic framing makes the VSM connection feel artificial rather than natural.

name	value	max_value	rationale
explanatory_value	2.0	5.0	The entity adds little genuine explanatory power beyond restating that banks need adequate reserves and prudent practices for stability. The "requisite variety" framing obscures rather than illuminates Smith's actual insights about banking operations.

Evaluation: Requisite Variety In Banking

definition_precision — 2.0 / 5.0

The definition conflates the cybernetic concept of "requisite variety" (from Ashby's Law) with basic banking prudence, creating conceptual confusion. Smith discusses banking reserves and lending practices but does not frame these in terms of matching "variety of demands" in the cybernetic sense.

source_grounding — 2.0 / 5.0

While Smith does discuss banking reserves and prudent lending in Book II, Chapter 2, he does not use or imply the concept of "requisite variety" as a organizing principle. This appears to be a modern cybernetic framework imposed on Smith's more straightforward discussion of banking stability.

domain_placement — 4.0 / 5.0

The "Regulation" domain is appropriate since Smith's discussion of banking practices in this chapter does concern regulatory and stability issues. The banking context is also correctly identified from the source material.

vsm_relevance — 3.0 / 5.0

The entity could map to S3 (internal regulation) given its focus on maintaining stability through reserves and lending practices. However, the forced cybernetic framing makes the VSM connection feel artificial rather than natural.

explanatory_value — 2.0 / 5.0

The entity adds little genuine explanatory power beyond restating that banks need adequate reserves and prudent practices for stability. The "requisite variety" framing obscures rather than illuminates Smith's actual insights about banking operations.

3.3 KiB Raw Blame History