feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,66 @@
|
||||
---
|
||||
entity_slug: colony_economic_system_evolution
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T04:54:01.727708'
|
||||
overall_score: 3.2
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: The definition captures a coherent concept about colonial economic development
|
||||
over time, but uses somewhat vague terms like "predictable patterns" and "various
|
||||
stages" without specifying what these actually entail. It's non-circular but could
|
||||
be more precise about the specific transformations involved.
|
||||
- name: source_grounding
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: Smith does indeed discuss colonial economic development in Book V, Chapter
|
||||
3, tracing how colonies evolve from initial settlements to more sophisticated
|
||||
economic systems. The entity accurately reflects his analysis of colonial economic
|
||||
progression, though it generalizes his observations into a broader evolutionary
|
||||
framework.
|
||||
- name: domain_placement
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: Placement in the "Accumulation" domain is appropriate since colonial
|
||||
economic evolution fundamentally concerns how wealth and capital accumulate and
|
||||
transform over time in colonial contexts. This aligns well with Smith's broader
|
||||
themes about economic development and capital formation.
|
||||
- name: vsm_relevance
|
||||
value: 2.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is too abstract and historical to map clearly to specific
|
||||
VSM systems - it describes a meta-process of systemic change rather than operational
|
||||
functions. While it might relate to S4 (adaptation) in a very general sense, it
|
||||
doesn't naturally fit the VSM framework's operational focus.
|
||||
- name: explanatory_value
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: The entity provides moderate explanatory value by highlighting that colonial
|
||||
economies follow developmental patterns rather than being static, but it remains
|
||||
somewhat descriptive rather than revealing specific causal mechanisms. It names
|
||||
an important phenomenon but doesn't deeply illuminate the underlying structural
|
||||
relations driving the evolution.
|
||||
---
|
||||
|
||||
# Evaluation: Colony Economic System Evolution
|
||||
|
||||
## definition_precision — 3.0 / 5.0
|
||||
|
||||
The definition captures a coherent concept about colonial economic development over time, but uses somewhat vague terms like "predictable patterns" and "various stages" without specifying what these actually entail. It's non-circular but could be more precise about the specific transformations involved.
|
||||
|
||||
## source_grounding — 4.0 / 5.0
|
||||
|
||||
Smith does indeed discuss colonial economic development in Book V, Chapter 3, tracing how colonies evolve from initial settlements to more sophisticated economic systems. The entity accurately reflects his analysis of colonial economic progression, though it generalizes his observations into a broader evolutionary framework.
|
||||
|
||||
## domain_placement — 4.0 / 5.0
|
||||
|
||||
Placement in the "Accumulation" domain is appropriate since colonial economic evolution fundamentally concerns how wealth and capital accumulate and transform over time in colonial contexts. This aligns well with Smith's broader themes about economic development and capital formation.
|
||||
|
||||
## vsm_relevance — 2.0 / 5.0
|
||||
|
||||
This entity is too abstract and historical to map clearly to specific VSM systems - it describes a meta-process of systemic change rather than operational functions. While it might relate to S4 (adaptation) in a very general sense, it doesn't naturally fit the VSM framework's operational focus.
|
||||
|
||||
## explanatory_value — 3.0 / 5.0
|
||||
|
||||
The entity provides moderate explanatory value by highlighting that colonial economies follow developmental patterns rather than being static, but it remains somewhat descriptive rather than revealing specific causal mechanisms. It names an important phenomenon but doesn't deeply illuminate the underlying structural relations driving the evolution.
|
||||
Reference in New Issue
Block a user