Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

requisite_variety

null

2026-02-23T06:17:34.361713

1.4

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails completely on this dimension.

name	value	max_value	rationale
source_grounding	1.0	5.0	"Requisite Variety" is a concept from cybernetics (specifically Ashby's Law) that does not appear in Adam Smith's "The Wealth of Nations." This appears to be an anachronistic imposition of 20th-century systems theory onto 18th-century economic thought.

name	value	max_value	rationale
domain_placement	1.0	5.0	The domain is listed as "unspecified," which provides no guidance for conceptual categorization. Given that requisite variety is fundamentally a cybernetic/systems concept rather than an economic one, proper domain placement is unclear.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Requisite variety is actually central to VSM theory and would naturally relate to multiple systems (particularly S2-S4 coordination and regulation functions). However, without proper definition or context, this potential relevance cannot be properly assessed or utilized.

name	value	max_value	rationale
explanatory_value	1.0	5.0	Without definition, context, or clear connection to the source material, this entity provides no explanatory power regarding Smith's economic mechanisms. It appears to be an empty placeholder that adds no analytical value to understanding "The Wealth of Nations."

Evaluation: Requisite Variety

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails completely on this dimension.

source_grounding — 1.0 / 5.0

"Requisite Variety" is a concept from cybernetics (specifically Ashby's Law) that does not appear in Adam Smith's "The Wealth of Nations." This appears to be an anachronistic imposition of 20th-century systems theory onto 18th-century economic thought.

domain_placement — 1.0 / 5.0

The domain is listed as "unspecified," which provides no guidance for conceptual categorization. Given that requisite variety is fundamentally a cybernetic/systems concept rather than an economic one, proper domain placement is unclear.

vsm_relevance — 3.0 / 5.0

Requisite variety is actually central to VSM theory and would naturally relate to multiple systems (particularly S2-S4 coordination and regulation functions). However, without proper definition or context, this potential relevance cannot be properly assessed or utilized.

explanatory_value — 1.0 / 5.0

Without definition, context, or clear connection to the source material, this entity provides no explanatory power regarding Smith's economic mechanisms. It appears to be an empty placeholder that adds no analytical value to understanding "The Wealth of Nations."

3.1 KiB Raw Blame History