Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_prosperity_symptoms

null

2026-02-23T05:11:30.239869

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies specific, measurable indicators (high wages, increasing population, liberal reward of labour) rather than vague concepts. It avoids circularity by defining prosperity symptoms through concrete observable phenomena rather than abstract notions of "wealth."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's Book I, Chapter 8, which explicitly discusses these indicators as "symptoms" of increasing national wealth. Smith specifically contrasts thriving economies (marked by high wages and population growth) with stagnant or declining ones.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this entity represents fundamental theoretical indicators that cut across multiple economic sectors. These symptoms are not specific to particular industries but rather general markers of overall economic health.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity functions primarily as S4 (intelligence) indicators that help assess environmental conditions and economic performance. However, it's somewhat VSM-neutral as it describes observable outcomes rather than active system functions or regulatory mechanisms.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides significant explanatory value by identifying concrete diagnostic criteria for economic health, enabling differentiation between thriving and struggling economies. While it describes symptoms rather than underlying mechanisms, these indicators are crucial for understanding economic dynamics and policy effectiveness.

Evaluation: Economic Prosperity Symptoms

definition_precision — 4.0 / 5.0

The definition clearly identifies specific, measurable indicators (high wages, increasing population, liberal reward of labour) rather than vague concepts. It avoids circularity by defining prosperity symptoms through concrete observable phenomena rather than abstract notions of "wealth."

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's Book I, Chapter 8, which explicitly discusses these indicators as "symptoms" of increasing national wealth. Smith specifically contrasts thriving economies (marked by high wages and population growth) with stagnant or declining ones.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this entity represents fundamental theoretical indicators that cut across multiple economic sectors. These symptoms are not specific to particular industries but rather general markers of overall economic health.

vsm_relevance — 3.0 / 5.0

This entity functions primarily as S4 (intelligence) indicators that help assess environmental conditions and economic performance. However, it's somewhat VSM-neutral as it describes observable outcomes rather than active system functions or regulatory mechanisms.

explanatory_value — 4.0 / 5.0

The entity provides significant explanatory value by identifying concrete diagnostic criteria for economic health, enabling differentiation between thriving and struggling economies. While it describes symptoms rather than underlying mechanisms, these indicators are crucial for understanding economic dynamics and policy effectiveness.

3.6 KiB Raw Blame History