Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

original_government_manners

null

2026-02-23T06:04:03.749573

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept about persistent institutional characteristics, but it's somewhat vague about what specifically constitutes these "manners" and how they mechanistically create barriers. The connection between social customs and economic development patterns could be more precisely articulated.

name	value	max_value	rationale
source_grounding	4.0	5.0	This appears well-grounded in Smith's analysis of European economic development in Book III, Chapter 1, where he discusses how historical governmental structures influenced economic patterns. The concept of institutional persistence affecting natural economic progression aligns with Smith's historical analysis.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain placement, as this entity deals with governmental structures and institutional frameworks that regulate economic activity. The focus on governmental manners and their constraining effects on economic development clearly falls within regulatory concerns.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S5 (identity/policy) as it concerns the fundamental governmental identity and policy frameworks that persist over time and shape systemic behavior. It also has relevance to S3 (internal regulation) in terms of how these institutional patterns regulate economic development.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by identifying institutional persistence as a mechanism that explains why European economic development diverged from Smith's "natural" progression. It illuminates how historical path dependence creates structural constraints on economic development patterns.

Evaluation: Original Government Manners

definition_precision — 3.0 / 5.0

The definition captures a distinct concept about persistent institutional characteristics, but it's somewhat vague about what specifically constitutes these "manners" and how they mechanistically create barriers. The connection between social customs and economic development patterns could be more precisely articulated.

source_grounding — 4.0 / 5.0

This appears well-grounded in Smith's analysis of European economic development in Book III, Chapter 1, where he discusses how historical governmental structures influenced economic patterns. The concept of institutional persistence affecting natural economic progression aligns with Smith's historical analysis.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain placement, as this entity deals with governmental structures and institutional frameworks that regulate economic activity. The focus on governmental manners and their constraining effects on economic development clearly falls within regulatory concerns.

vsm_relevance — 4.0 / 5.0

This entity maps well to S5 (identity/policy) as it concerns the fundamental governmental identity and policy frameworks that persist over time and shape systemic behavior. It also has relevance to S3 (internal regulation) in terms of how these institutional patterns regulate economic development.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by identifying institutional persistence as a mechanism that explains why European economic development diverged from Smith's "natural" progression. It illuminates how historical path dependence creates structural constraints on economic development patterns.

3.7 KiB Raw Blame History