feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: colonial_economic_system_learning
evaluator: null
evaluated_at: '2026-02-23T04:49:21.533761'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a reasonably distinct concept about knowledge
acquisition in colonial economies, but uses somewhat vague terms like "effective
economic practices" and "better learning processes" without clear criteria for
what constitutes effectiveness or improvement.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does discuss learning and experimentation in colonial contexts,
particularly emphasizing how market mechanisms provide better learning opportunities
than monopolistic control systems. The entity appears well-grounded in his actual
arguments about colonial economic development.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is appropriate as this concept spans multiple economic
domains and represents a meta-level process about how economic knowledge develops.
It''s not specific to trade, production, or any particular economic sector.'
- name: vsm_relevance
value: 5.0
max_value: 5.0
rationale: This entity maps very naturally to S4 (intelligence/environmental adaptation)
as it describes how colonial economic systems gather information about their environment
and adapt their practices accordingly. It could also relate to S3 (internal regulation)
in terms of policy adjustment.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity illuminates an important mechanism by which colonial economies
improve over time through feedback and adaptation, distinguishing between different
institutional arrangements' capacity to facilitate learning. This provides genuine
insight into Smith's theory of economic development.
---
# Evaluation: Colonial Economic System Learning
## definition_precision — 3.0 / 5.0
The definition captures a reasonably distinct concept about knowledge acquisition in colonial economies, but uses somewhat vague terms like "effective economic practices" and "better learning processes" without clear criteria for what constitutes effectiveness or improvement.
## source_grounding — 4.0 / 5.0
Smith does discuss learning and experimentation in colonial contexts, particularly emphasizing how market mechanisms provide better learning opportunities than monopolistic control systems. The entity appears well-grounded in his actual arguments about colonial economic development.
## domain_placement — 4.0 / 5.0
"General Theory" is appropriate as this concept spans multiple economic domains and represents a meta-level process about how economic knowledge develops. It's not specific to trade, production, or any particular economic sector.
## vsm_relevance — 5.0 / 5.0
This entity maps very naturally to S4 (intelligence/environmental adaptation) as it describes how colonial economic systems gather information about their environment and adapt their practices accordingly. It could also relate to S3 (internal regulation) in terms of policy adjustment.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important mechanism by which colonial economies improve over time through feedback and adaptation, distinguishing between different institutional arrangements' capacity to facilitate learning. This provides genuine insight into Smith's theory of economic development.