Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_adaptation

null

2026-02-23T05:12:31.645449

3.4

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about economic systems evolving over time, but it's somewhat broad and could apply to many different types of change. The phrase "changing circumstances" is vague and the definition doesn't clearly distinguish this from general economic evolution or policy adjustment.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss different economic systems and their historical context, the specific concept of "adaptation" as a dynamic process is largely inferred rather than explicitly articulated by Smith. The entity extrapolates beyond what Smith directly states about economic systems responding to circumstances.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate since this concept spans across different economic domains and represents a meta-principle about how economic systems function. It's correctly placed as a broad theoretical concept rather than in a specific economic sector.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps very naturally to S4 (intelligence/environmental adaptation) in the VSM, as it directly concerns how economic systems sense environmental changes and adapt accordingly. It represents exactly the kind of adaptive intelligence function that S4 embodies.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The concept provides some explanatory value by highlighting the adaptive nature of economic systems, but it remains at a high level of abstraction. It names an important phenomenon but doesn't deeply illuminate the specific mechanisms by which adaptation occurs or the structural relations involved.

Evaluation: Economic System Adaptation

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about economic systems evolving over time, but it's somewhat broad and could apply to many different types of change. The phrase "changing circumstances" is vague and the definition doesn't clearly distinguish this from general economic evolution or policy adjustment.

source_grounding — 2.0 / 5.0

While Smith does discuss different economic systems and their historical context, the specific concept of "adaptation" as a dynamic process is largely inferred rather than explicitly articulated by Smith. The entity extrapolates beyond what Smith directly states about economic systems responding to circumstances.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate since this concept spans across different economic domains and represents a meta-principle about how economic systems function. It's correctly placed as a broad theoretical concept rather than in a specific economic sector.

vsm_relevance — 5.0 / 5.0

This entity maps very naturally to S4 (intelligence/environmental adaptation) in the VSM, as it directly concerns how economic systems sense environmental changes and adapt accordingly. It represents exactly the kind of adaptive intelligence function that S4 embodies.

explanatory_value — 3.0 / 5.0

The concept provides some explanatory value by highlighting the adaptive nature of economic systems, but it remains at a high level of abstraction. It names an important phenomenon but doesn't deeply illuminate the specific mechanisms by which adaptation occurs or the structural relations involved.

3.6 KiB Raw Blame History