Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_efficiency_analysis

null

2026-02-23T04:45:41.721693

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes this as a systematic examination of resource allocation efficiency in colonial contexts, with specific focus on comparing actual vs. potential outcomes under different policy arrangements. While comprehensive, it could be slightly more precise about what constitutes "systematic examination" versus ad hoc observations.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analytical approach in Book IV, Chapter 7, where he consistently compares the efficiency outcomes of monopoly colonial policies against free trade alternatives. Smith explicitly conducts this type of comparative efficiency analysis throughout his colonial policy discussions.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since this represents Smith's broader analytical methodology for evaluating economic policies rather than a specific policy instrument or market mechanism. It captures a theoretical framework that spans multiple specific applications.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps most naturally to S3 (internal regulation/audit) as it involves systematic evaluation and monitoring of economic performance, but it also has S4 elements in comparing alternative arrangements. The mapping is somewhat diffuse across multiple systems rather than having a clear primary VSM home.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates Smith's methodological approach to policy evaluation and reveals the analytical structure underlying his critiques of colonial monopolies. It adds explanatory power by identifying the systematic nature of his efficiency comparisons, though it describes methodology rather than discovering new economic mechanisms.

Evaluation: Colonial Economic Efficiency Analysis

definition_precision — 4.0 / 5.0

The definition clearly distinguishes this as a systematic examination of resource allocation efficiency in colonial contexts, with specific focus on comparing actual vs. potential outcomes under different policy arrangements. While comprehensive, it could be slightly more precise about what constitutes "systematic examination" versus ad hoc observations.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analytical approach in Book IV, Chapter 7, where he consistently compares the efficiency outcomes of monopoly colonial policies against free trade alternatives. Smith explicitly conducts this type of comparative efficiency analysis throughout his colonial policy discussions.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since this represents Smith's broader analytical methodology for evaluating economic policies rather than a specific policy instrument or market mechanism. It captures a theoretical framework that spans multiple specific applications.

vsm_relevance — 3.0 / 5.0

This entity maps most naturally to S3 (internal regulation/audit) as it involves systematic evaluation and monitoring of economic performance, but it also has S4 elements in comparing alternative arrangements. The mapping is somewhat diffuse across multiple systems rather than having a clear primary VSM home.

explanatory_value — 4.0 / 5.0

This entity illuminates Smith's methodological approach to policy evaluation and reveals the analytical structure underlying his critiques of colonial monopolies. It adds explanatory power by identifying the systematic nature of his efficiency comparisons, though it describes methodology rather than discovering new economic mechanisms.

3.9 KiB Raw Blame History