feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: economic_systems_distinction
evaluator: null
evaluated_at: '2026-02-23T05:22:04.958840'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a legitimate conceptual distinction but remains
somewhat vague with phrases like "different approaches to organizing economic
activity." While it identifies the commercial vs. agricultural contrast, it doesn't
precisely delineate what constitutes each system or their specific characteristics.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual framework from Book IV,
where he explicitly analyzes different systems of political economy, particularly
contrasting mercantile/commercial systems with physiocratic/agricultural approaches.
The distinction between these systems is a central organizing principle of his
work.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement since this represents
Smith''s foundational theoretical framework for understanding different economic
arrangements. This meta-level distinction underpins his subsequent analysis of
specific policies and mechanisms.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps naturally to S4 (intelligence/environmental adaptation)
as it represents Smith's analytical framework for understanding how different
economic systems adapt to and shape their environments. It could also relate to
S5 (identity/policy) as it concerns fundamental choices about economic organization.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides significant explanatory value by establishing the
conceptual foundation for understanding why different economic policies and institutions
emerge in different contexts. It illuminates the structural logic behind Smith's
comparative analysis of economic systems rather than merely describing surface
phenomena.
---
# Evaluation: Economic Systems Distinction
## definition_precision — 3.0 / 5.0
The definition captures a legitimate conceptual distinction but remains somewhat vague with phrases like "different approaches to organizing economic activity." While it identifies the commercial vs. agricultural contrast, it doesn't precisely delineate what constitutes each system or their specific characteristics.
## source_grounding — 4.0 / 5.0
This entity is well-grounded in Smith's actual framework from Book IV, where he explicitly analyzes different systems of political economy, particularly contrasting mercantile/commercial systems with physiocratic/agricultural approaches. The distinction between these systems is a central organizing principle of his work.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement since this represents Smith's foundational theoretical framework for understanding different economic arrangements. This meta-level distinction underpins his subsequent analysis of specific policies and mechanisms.
## vsm_relevance — 4.0 / 5.0
This entity maps naturally to S4 (intelligence/environmental adaptation) as it represents Smith's analytical framework for understanding how different economic systems adapt to and shape their environments. It could also relate to S5 (identity/policy) as it concerns fundamental choices about economic organization.
## explanatory_value — 4.0 / 5.0
This entity provides significant explanatory value by establishing the conceptual foundation for understanding why different economic policies and institutions emerge in different contexts. It illuminates the structural logic behind Smith's comparative analysis of economic systems rather than merely describing surface phenomena.