feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: colonial_economic_efficiency_analysis
evaluator: null
evaluated_at: '2026-02-23T04:45:41.721693'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes this as a systematic examination
of resource allocation efficiency in colonial contexts, with specific focus on
comparing actual vs. potential outcomes under different policy arrangements. While
comprehensive, it could be slightly more precise about what constitutes "systematic
examination" versus ad hoc observations.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual analytical approach in
Book IV, Chapter 7, where he consistently compares the efficiency outcomes of
monopoly colonial policies against free trade alternatives. Smith explicitly conducts
this type of comparative efficiency analysis throughout his colonial policy discussions.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement since this represents
Smith''s broader analytical methodology for evaluating economic policies rather
than a specific policy instrument or market mechanism. It captures a theoretical
framework that spans multiple specific applications.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity maps most naturally to S3 (internal regulation/audit) as
it involves systematic evaluation and monitoring of economic performance, but
it also has S4 elements in comparing alternative arrangements. The mapping is
somewhat diffuse across multiple systems rather than having a clear primary VSM
home.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity illuminates Smith's methodological approach to policy evaluation
and reveals the analytical structure underlying his critiques of colonial monopolies.
It adds explanatory power by identifying the systematic nature of his efficiency
comparisons, though it describes methodology rather than discovering new economic
mechanisms.
---
# Evaluation: Colonial Economic Efficiency Analysis
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes this as a systematic examination of resource allocation efficiency in colonial contexts, with specific focus on comparing actual vs. potential outcomes under different policy arrangements. While comprehensive, it could be slightly more precise about what constitutes "systematic examination" versus ad hoc observations.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual analytical approach in Book IV, Chapter 7, where he consistently compares the efficiency outcomes of monopoly colonial policies against free trade alternatives. Smith explicitly conducts this type of comparative efficiency analysis throughout his colonial policy discussions.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement since this represents Smith's broader analytical methodology for evaluating economic policies rather than a specific policy instrument or market mechanism. It captures a theoretical framework that spans multiple specific applications.
## vsm_relevance — 3.0 / 5.0
This entity maps most naturally to S3 (internal regulation/audit) as it involves systematic evaluation and monitoring of economic performance, but it also has S4 elements in comparing alternative arrangements. The mapping is somewhat diffuse across multiple systems rather than having a clear primary VSM home.
## explanatory_value — 4.0 / 5.0
This entity illuminates Smith's methodological approach to policy evaluation and reveals the analytical structure underlying his critiques of colonial monopolies. It adds explanatory power by identifying the systematic nature of his efficiency comparisons, though it describes methodology rather than discovering new economic mechanisms.