feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: commercial_development_sequence_inversion
evaluator: null
evaluated_at: '2026-02-23T04:57:42.464138'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures a specific historical pattern - the reversal
of expected development sequence where commerce/manufacturing preceded agriculture
in Europe versus the "natural" order seen in colonies. The concept is distinct
and well-bounded, though it could be slightly more precise about what constitutes
"natural order."
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's analysis in Book III, Chapter
4, where he explicitly discusses how European development inverted the natural
progression and compares this unfavorably to colonial development patterns. The
entity accurately reflects Smith's actual argument about historical development
sequences.
- name: domain_placement
value: 3.0
max_value: 5.0
rationale: While no domain is specified, this entity spans multiple economic domains
- it involves agricultural economics, commercial development, and historical economic
analysis. It would benefit from clearer domain categorization, possibly as "Economic
Development" or "Historical Economics."
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it describes how economic systems adapt to environmental constraints and historical
circumstances. It also touches on S1 (primary operations) in terms of the sequencing
of fundamental economic activities.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by identifying a structural
mechanism that explains why European agricultural development was "slow and uncertain"
compared to colonies. It illuminates a fundamental pattern in economic development
rather than merely describing surface phenomena.
---
# Evaluation: Commercial Development Sequence Inversion
## definition_precision — 4.0 / 5.0
The definition clearly captures a specific historical pattern - the reversal of expected development sequence where commerce/manufacturing preceded agriculture in Europe versus the "natural" order seen in colonies. The concept is distinct and well-bounded, though it could be slightly more precise about what constitutes "natural order."
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's analysis in Book III, Chapter 4, where he explicitly discusses how European development inverted the natural progression and compares this unfavorably to colonial development patterns. The entity accurately reflects Smith's actual argument about historical development sequences.
## domain_placement — 3.0 / 5.0
While no domain is specified, this entity spans multiple economic domains - it involves agricultural economics, commercial development, and historical economic analysis. It would benefit from clearer domain categorization, possibly as "Economic Development" or "Historical Economics."
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to environmental constraints and historical circumstances. It also touches on S1 (primary operations) in terms of the sequencing of fundamental economic activities.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by identifying a structural mechanism that explains why European agricultural development was "slow and uncertain" compared to colonies. It illuminates a fundamental pattern in economic development rather than merely describing surface phenomena.