feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,64 @@
|
||||
---
|
||||
entity_slug: colonial_economic_system_evolution
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T04:48:38.260897'
|
||||
overall_score: 4.0
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: The definition captures a distinct evolutionary process but remains somewhat
|
||||
vague with phrases like "natural development of economic capabilities" and "more
|
||||
complex commercial and industrial systems." It could be more precise about what
|
||||
specific mechanisms drive this evolution.
|
||||
- name: source_grounding
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This concept is well-grounded in Smith's analysis of colonial development
|
||||
in Book IV, Chapter 7, where he discusses how colonies naturally progress economically
|
||||
when not constrained by monopolistic policies. The emphasis on "natural evolution"
|
||||
versus artificial restrictions directly reflects Smith's arguments.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: '"General Theory" is the appropriate domain placement as this entity
|
||||
describes a broad theoretical framework about economic development patterns rather
|
||||
than specific mechanisms or policies. It represents Smith''s general principles
|
||||
about natural economic evolution.'
|
||||
- name: vsm_relevance
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
|
||||
it describes how colonial economies adapt and evolve in response to changing conditions
|
||||
and opportunities. It also touches on S5 (identity/policy) regarding the fundamental
|
||||
development trajectory of colonial systems.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The entity provides genuine explanatory power by illuminating the structural
|
||||
mechanism of how colonial economies naturally develop over time and how policy
|
||||
interventions can distort this process. It helps explain Smith's broader theory
|
||||
of economic development and the costs of mercantile restrictions.
|
||||
---
|
||||
|
||||
# Evaluation: Colonial Economic System Evolution
|
||||
|
||||
## definition_precision — 3.0 / 5.0
|
||||
|
||||
The definition captures a distinct evolutionary process but remains somewhat vague with phrases like "natural development of economic capabilities" and "more complex commercial and industrial systems." It could be more precise about what specific mechanisms drive this evolution.
|
||||
|
||||
## source_grounding — 4.0 / 5.0
|
||||
|
||||
This concept is well-grounded in Smith's analysis of colonial development in Book IV, Chapter 7, where he discusses how colonies naturally progress economically when not constrained by monopolistic policies. The emphasis on "natural evolution" versus artificial restrictions directly reflects Smith's arguments.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
"General Theory" is the appropriate domain placement as this entity describes a broad theoretical framework about economic development patterns rather than specific mechanisms or policies. It represents Smith's general principles about natural economic evolution.
|
||||
|
||||
## vsm_relevance — 4.0 / 5.0
|
||||
|
||||
This entity maps well to S4 (intelligence/environmental adaptation) as it describes how colonial economies adapt and evolve in response to changing conditions and opportunities. It also touches on S5 (identity/policy) regarding the fundamental development trajectory of colonial systems.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
The entity provides genuine explanatory power by illuminating the structural mechanism of how colonial economies naturally develop over time and how policy interventions can distort this process. It helps explain Smith's broader theory of economic development and the costs of mercantile restrictions.
|
||||
Reference in New Issue
Block a user