Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

national_economic_identity

null

2026-02-23T05:57:09.111648

3.4

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about nations having distinct economic characteristics, but it's somewhat broad and could encompass multiple related but distinct phenomena. The phrase "characteristic economic system and approach" is reasonably clear but could be more precise about what specifically constitutes this identity.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss how different nations adopt different systems of political economy, the specific concept of "National Economic Identity" as a distinct analytical category is not explicitly developed in the source text. This appears to be an interpretive synthesis that goes beyond what Smith directly articulates.

name	value	max_value	rationale
domain_placement	4.0	5.0	The placement in "General Theory" is appropriate since this concept would span across Smith's various discussions of different national approaches to political economy. It's sufficiently broad and foundational to warrant this domain classification rather than being placed in a more specific economic category.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps very naturally to S5 (identity/policy) in the VSM, as it directly concerns how a nation defines its fundamental economic character and approach. It represents the highest-level identity function that shapes all other economic decisions and structures within the national system.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The concept provides some explanatory value by offering a framework for understanding why nations develop different economic approaches, but it remains somewhat descriptive rather than revealing deep structural mechanisms. It names an important phenomenon but doesn't fully illuminate the underlying processes that create or maintain this identity.

Evaluation: National Economic Identity

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about nations having distinct economic characteristics, but it's somewhat broad and could encompass multiple related but distinct phenomena. The phrase "characteristic economic system and approach" is reasonably clear but could be more precise about what specifically constitutes this identity.

source_grounding — 2.0 / 5.0

While Smith does discuss how different nations adopt different systems of political economy, the specific concept of "National Economic Identity" as a distinct analytical category is not explicitly developed in the source text. This appears to be an interpretive synthesis that goes beyond what Smith directly articulates.

domain_placement — 4.0 / 5.0

The placement in "General Theory" is appropriate since this concept would span across Smith's various discussions of different national approaches to political economy. It's sufficiently broad and foundational to warrant this domain classification rather than being placed in a more specific economic category.

vsm_relevance — 5.0 / 5.0

This entity maps very naturally to S5 (identity/policy) in the VSM, as it directly concerns how a nation defines its fundamental economic character and approach. It represents the highest-level identity function that shapes all other economic decisions and structures within the national system.

explanatory_value — 3.0 / 5.0

The concept provides some explanatory value by offering a framework for understanding why nations develop different economic approaches, but it remains somewhat descriptive rather than revealing deep structural mechanisms. It names an important phenomenon but doesn't fully illuminate the underlying processes that create or maintain this identity.

3.9 KiB Raw Blame History