Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_adaptation

null

2026-02-23T04:44:38.665614

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes adaptive capacity from static economic arrangements and identifies specific mechanisms (decentralized decision-making, market-driven adjustments). It avoids circularity by explaining adaptation in terms of concrete responses to external changes.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith extensively discusses how monopoly policies constrain colonial economies' ability to respond to changing market conditions, and he advocates for more flexible arrangements that would allow better adaptation. The concept is well-grounded in his critique of mercantile restrictions.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain since this concept represents a fundamental principle about how economic systems function under different institutional arrangements. It's a theoretical insight about system behavior rather than a specific policy or mechanism.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps directly to System 4 (intelligence/environmental adaptation) in the VSM, as it specifically concerns how economic systems sense and respond to environmental changes. The connection between economic freedom and adaptive capacity is a core S4 function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates a key structural relationship between institutional arrangements and system performance, explaining why Smith favors market-based over monopolistic colonial policies. It provides genuine insight into the mechanisms that enable or constrain economic responsiveness.

Evaluation: Colonial Economic Adaptation

definition_precision — 4.0 / 5.0

The definition clearly distinguishes adaptive capacity from static economic arrangements and identifies specific mechanisms (decentralized decision-making, market-driven adjustments). It avoids circularity by explaining adaptation in terms of concrete responses to external changes.

source_grounding — 4.0 / 5.0

Smith extensively discusses how monopoly policies constrain colonial economies' ability to respond to changing market conditions, and he advocates for more flexible arrangements that would allow better adaptation. The concept is well-grounded in his critique of mercantile restrictions.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain since this concept represents a fundamental principle about how economic systems function under different institutional arrangements. It's a theoretical insight about system behavior rather than a specific policy or mechanism.

vsm_relevance — 5.0 / 5.0

This entity maps directly to System 4 (intelligence/environmental adaptation) in the VSM, as it specifically concerns how economic systems sense and respond to environmental changes. The connection between economic freedom and adaptive capacity is a core S4 function.

explanatory_value — 4.0 / 5.0

The entity illuminates a key structural relationship between institutional arrangements and system performance, explaining why Smith favors market-based over monopolistic colonial policies. It provides genuine insight into the mechanisms that enable or constrain economic responsiveness.

3.5 KiB Raw Blame History