feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: economic_system_development
evaluator: null
evaluated_at: '2026-02-23T05:14:28.316118'
overall_score: 3.2
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept about economic evolution but
remains somewhat broad and umbrella-like. While it identifies key components (emergence,
modification, driving factors), it could be more precise about what constitutes
"economic arrangements" and the specific mechanisms of change.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: The entity claims to derive from "Book IV, Chapter 0" which is problematic
since Book IV doesn't have a Chapter 0 in Smith's work. While Smith does discuss
different economic systems across nations and time periods, this specific framing
of "developmental progression" may impose a more modern evolutionary perspective
than Smith explicitly articulated.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is an appropriate domain placement since this concept
spans across Smith''s various discussions of mercantilism, physiocracy, and natural
liberty rather than belonging to a specific economic sector. The broad theoretical
nature fits this categorization well.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it concerns how economic systems adapt and evolve in response to changing conditions
over time. It could also relate to S5 (identity/policy) regarding fundamental
systemic changes in economic organization.
- name: explanatory_value
value: 3.0
max_value: 5.0
rationale: The entity provides moderate explanatory value by highlighting the dynamic
nature of economic systems, but it remains somewhat descriptive rather than illuminating
specific mechanisms. It names an important phenomenon but doesn't deeply explain
the structural relations that drive economic system evolution.
---
# Evaluation: Economic System Development
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept about economic evolution but remains somewhat broad and umbrella-like. While it identifies key components (emergence, modification, driving factors), it could be more precise about what constitutes "economic arrangements" and the specific mechanisms of change.
## source_grounding — 2.0 / 5.0
The entity claims to derive from "Book IV, Chapter 0" which is problematic since Book IV doesn't have a Chapter 0 in Smith's work. While Smith does discuss different economic systems across nations and time periods, this specific framing of "developmental progression" may impose a more modern evolutionary perspective than Smith explicitly articulated.
## domain_placement — 4.0 / 5.0
"General Theory" is an appropriate domain placement since this concept spans across Smith's various discussions of mercantilism, physiocracy, and natural liberty rather than belonging to a specific economic sector. The broad theoretical nature fits this categorization well.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt and evolve in response to changing conditions over time. It could also relate to S5 (identity/policy) regarding fundamental systemic changes in economic organization.
## explanatory_value — 3.0 / 5.0
The entity provides moderate explanatory value by highlighting the dynamic nature of economic systems, but it remains somewhat descriptive rather than illuminating specific mechanisms. It names an important phenomenon but doesn't deeply explain the structural relations that drive economic system evolution.