Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_sustainability

null

2026-02-23T05:21:21.427046

3.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about long-term viability of economic systems, but uses somewhat vague terms like "effectiveness" and "desired outcomes" without specifying what these mean. The core idea of maintaining operations without depleting foundational resources is reasonably precise.

name	value	max_value	rationale
source_grounding	2.0	5.0	The entity acknowledges that sustainability is "not explicitly discussed by Smith" and is only "implied" in his discussion of systems enriching people and sovereigns. This represents a significant conceptual leap from what Smith actually wrote, introducing modern sustainability frameworks onto 18th-century economic theory.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate since this concept would span across multiple economic domains rather than belonging to a specific area like trade policy or taxation. The broad theoretical nature of sustainability as a systemic property fits well in this domain.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to VSM System 5 (identity/policy) as it concerns the fundamental viability and continuity of the entire economic system. It also has relevance to S4 (environmental adaptation) regarding how systems maintain themselves amid changing conditions.

name	value	max_value	rationale
explanatory_value	2.0	5.0	While sustainability is an important modern concept, this entity doesn't illuminate specific mechanisms or structural relations that Smith described. It functions more as a modern analytical overlay than as an explanation of how Smith's economic systems actually operate.

Evaluation: Economic System Sustainability

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about long-term viability of economic systems, but uses somewhat vague terms like "effectiveness" and "desired outcomes" without specifying what these mean. The core idea of maintaining operations without depleting foundational resources is reasonably precise.

source_grounding — 2.0 / 5.0

The entity acknowledges that sustainability is "not explicitly discussed by Smith" and is only "implied" in his discussion of systems enriching people and sovereigns. This represents a significant conceptual leap from what Smith actually wrote, introducing modern sustainability frameworks onto 18th-century economic theory.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate since this concept would span across multiple economic domains rather than belonging to a specific area like trade policy or taxation. The broad theoretical nature of sustainability as a systemic property fits well in this domain.

vsm_relevance — 4.0 / 5.0

This entity maps well to VSM System 5 (identity/policy) as it concerns the fundamental viability and continuity of the entire economic system. It also has relevance to S4 (environmental adaptation) regarding how systems maintain themselves amid changing conditions.

explanatory_value — 2.0 / 5.0

While sustainability is an important modern concept, this entity doesn't illuminate specific mechanisms or structural relations that Smith described. It functions more as a modern analytical overlay than as an explanation of how Smith's economic systems actually operate.

3.5 KiB Raw Blame History