Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_innovation

null

2026-02-23T05:17:21.877707

2.6

name	value	max_value	rationale
definition_precision	2.0	5.0	The definition is overly broad and vague, essentially describing any change or improvement in economic systems without clear boundaries. It reads more like a general description of economic progress than a precise concept that can be operationalized or distinguished from related phenomena.

name	value	max_value	rationale
source_grounding	2.0	5.0	The entity claims to derive from "Book IV, Chapter 0" (which doesn't exist - Book IV has no Chapter 0) and relies on vague references to Smith's "discussion of modern systems and their advantages." This appears to extrapolate far beyond what Smith actually discusses, imposing modern innovation terminology on 18th-century economic analysis.

name	value	max_value	rationale
domain_placement	3.0	5.0	"General Theory" is appropriate given the broad, abstract nature of the concept, though the concept itself may be too diffuse to warrant its own entity. The domain placement correctly reflects that this doesn't fit neatly into more specific economic categories like trade, production, or policy.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This concept maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems develop new approaches to adapt to changing conditions. The innovation aspect directly relates to the intelligence function's role in environmental scanning and system evolution.

name	value	max_value	rationale
explanatory_value	2.0	5.0	The entity provides little explanatory power beyond naming a general phenomenon of economic change. It doesn't illuminate specific mechanisms, causal relationships, or structural features that would help understand how economic systems actually function or evolve.

Evaluation: Economic System Innovation

definition_precision — 2.0 / 5.0

The definition is overly broad and vague, essentially describing any change or improvement in economic systems without clear boundaries. It reads more like a general description of economic progress than a precise concept that can be operationalized or distinguished from related phenomena.

source_grounding — 2.0 / 5.0

The entity claims to derive from "Book IV, Chapter 0" (which doesn't exist - Book IV has no Chapter 0) and relies on vague references to Smith's "discussion of modern systems and their advantages." This appears to extrapolate far beyond what Smith actually discusses, imposing modern innovation terminology on 18th-century economic analysis.

domain_placement — 3.0 / 5.0

"General Theory" is appropriate given the broad, abstract nature of the concept, though the concept itself may be too diffuse to warrant its own entity. The domain placement correctly reflects that this doesn't fit neatly into more specific economic categories like trade, production, or policy.

vsm_relevance — 4.0 / 5.0

This concept maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems develop new approaches to adapt to changing conditions. The innovation aspect directly relates to the intelligence function's role in environmental scanning and system evolution.

explanatory_value — 2.0 / 5.0

The entity provides little explanatory power beyond naming a general phenomenon of economic change. It doesn't illuminate specific mechanisms, causal relationships, or structural features that would help understand how economic systems actually function or evolve.

3.6 KiB Raw Blame History