feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,62 @@
---
entity_slug: requisite_variety_in_banking
evaluator: null
evaluated_at: '2026-02-23T06:17:25.652373'
overall_score: 2.6
scores:
- name: definition_precision
value: 2.0
max_value: 5.0
rationale: The definition conflates the cybernetic concept of "requisite variety"
(from Ashby's Law) with basic banking prudence, creating conceptual confusion.
Smith discusses banking reserves and lending practices but does not frame these
in terms of matching "variety of demands" in the cybernetic sense.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does discuss banking reserves and prudent lending in Book
II, Chapter 2, he does not use or imply the concept of "requisite variety" as
a organizing principle. This appears to be a modern cybernetic framework imposed
on Smith's more straightforward discussion of banking stability.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "Regulation" domain is appropriate since Smith's discussion of banking
practices in this chapter does concern regulatory and stability issues. The banking
context is also correctly identified from the source material.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: The entity could map to S3 (internal regulation) given its focus on maintaining
stability through reserves and lending practices. However, the forced cybernetic
framing makes the VSM connection feel artificial rather than natural.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity adds little genuine explanatory power beyond restating that
banks need adequate reserves and prudent practices for stability. The "requisite
variety" framing obscures rather than illuminates Smith's actual insights about
banking operations.
---
# Evaluation: Requisite Variety In Banking
## definition_precision — 2.0 / 5.0
The definition conflates the cybernetic concept of "requisite variety" (from Ashby's Law) with basic banking prudence, creating conceptual confusion. Smith discusses banking reserves and lending practices but does not frame these in terms of matching "variety of demands" in the cybernetic sense.
## source_grounding — 2.0 / 5.0
While Smith does discuss banking reserves and prudent lending in Book II, Chapter 2, he does not use or imply the concept of "requisite variety" as a organizing principle. This appears to be a modern cybernetic framework imposed on Smith's more straightforward discussion of banking stability.
## domain_placement — 4.0 / 5.0
The "Regulation" domain is appropriate since Smith's discussion of banking practices in this chapter does concern regulatory and stability issues. The banking context is also correctly identified from the source material.
## vsm_relevance — 3.0 / 5.0
The entity could map to S3 (internal regulation) given its focus on maintaining stability through reserves and lending practices. However, the forced cybernetic framing makes the VSM connection feel artificial rather than natural.
## explanatory_value — 2.0 / 5.0
The entity adds little genuine explanatory power beyond restating that banks need adequate reserves and prudent practices for stability. The "requisite variety" framing obscures rather than illuminates Smith's actual insights about banking operations.