Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_system_governance

null

2026-02-23T04:54:19.393706

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a meaningful concept but is somewhat broad, encompassing both "formal governmental structures and informal market mechanisms." While not circular, it could be more precise about what specifically constitutes these "institutional arrangements and decision-making processes."

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's actual analysis in Book V, Chapter 3, where he extensively discusses colonial governance and critiques excessive central control over colonial economic activity. The concept directly reflects Smith's examination of how different governance approaches affect colonial economic development.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate for this entity, as it deals with the institutional and governmental frameworks that regulate economic activity in colonies. This is clearly a regulatory rather than production, exchange, or distribution concept.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to multiple VSM systems, particularly S3 (internal regulation/audit) for the governance mechanisms and S5 (identity/policy) for the overarching institutional frameworks. It represents the regulatory and policy-setting functions that Smith analyzes in colonial contexts.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating Smith's key insight about the tension between centralized control and market mechanisms in colonial governance. It captures an important structural relationship that Smith uses to explain colonial economic performance.

Evaluation: Colony Economic System Governance

definition_precision — 3.0 / 5.0

The definition captures a meaningful concept but is somewhat broad, encompassing both "formal governmental structures and informal market mechanisms." While not circular, it could be more precise about what specifically constitutes these "institutional arrangements and decision-making processes."

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's actual analysis in Book V, Chapter 3, where he extensively discusses colonial governance and critiques excessive central control over colonial economic activity. The concept directly reflects Smith's examination of how different governance approaches affect colonial economic development.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate for this entity, as it deals with the institutional and governmental frameworks that regulate economic activity in colonies. This is clearly a regulatory rather than production, exchange, or distribution concept.

vsm_relevance — 4.0 / 5.0

This entity maps well to multiple VSM systems, particularly S3 (internal regulation/audit) for the governance mechanisms and S5 (identity/policy) for the overarching institutional frameworks. It represents the regulatory and policy-setting functions that Smith analyzes in colonial contexts.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating Smith's key insight about the tension between centralized control and market mechanisms in colonial governance. It captures an important structural relationship that Smith uses to explain colonial economic performance.

3.6 KiB Raw Blame History